-- Logs begin at Mon 2022-10-24 08:03:29 UTC, end at Mon 2022-10-24 09:06:43 UTC. -- Oct 24 08:38:51.148803 dv-cinder-master-3-smb systemd[1]: Starting Devstack devstack@n-api.service... Oct 24 08:38:51.158643 dv-cinder-master-3-smb devstack@n-api.service[110137]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 24 08:38:51.159907 dv-cinder-master-3-smb devstack@n-api.service[110137]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 24 08:38:51 2022] *** Oct 24 08:38:51.159907 dv-cinder-master-3-smb devstack@n-api.service[110137]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 24 08:38:51.159907 dv-cinder-master-3-smb devstack@n-api.service[110137]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 24 08:38:51.159907 dv-cinder-master-3-smb devstack@n-api.service[110137]: nodename: dv-cinder-master-3-smb Oct 24 08:38:51.159907 dv-cinder-master-3-smb devstack@n-api.service[110137]: machine: x86_64 Oct 24 08:38:51.159907 dv-cinder-master-3-smb devstack@n-api.service[110137]: clock source: unix Oct 24 08:38:51.159907 dv-cinder-master-3-smb devstack@n-api.service[110137]: pcre jit disabled Oct 24 08:38:51.159907 dv-cinder-master-3-smb devstack@n-api.service[110137]: detected number of CPU cores: 4 Oct 24 08:38:51.159907 dv-cinder-master-3-smb devstack@n-api.service[110137]: current working directory: / Oct 24 08:38:51.159907 dv-cinder-master-3-smb devstack@n-api.service[110137]: detected binary path: /usr/bin/uwsgi-core Oct 24 08:38:51.159907 dv-cinder-master-3-smb devstack@n-api.service[110137]: your processes number limit is 47680 Oct 24 08:38:51.159907 dv-cinder-master-3-smb devstack@n-api.service[110137]: your memory page size is 4096 bytes Oct 24 08:38:51.159907 dv-cinder-master-3-smb devstack@n-api.service[110137]: detected max file descriptor number: 2048 Oct 24 08:38:51.159907 dv-cinder-master-3-smb devstack@n-api.service[110137]: lock engine: pthread robust mutexes Oct 24 08:38:51.160705 dv-cinder-master-3-smb devstack@n-api.service[110137]: thunder lock: enabled Oct 24 08:38:51.160705 dv-cinder-master-3-smb devstack@n-api.service[110137]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 24 08:38:51.160705 dv-cinder-master-3-smb devstack@n-api.service[110137]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 24 08:38:51.199682 dv-cinder-master-3-smb devstack@n-api.service[110137]: Python main interpreter initialized at 0x55bc457029c0 Oct 24 08:38:51.199682 dv-cinder-master-3-smb devstack@n-api.service[110137]: python threads support enabled Oct 24 08:38:51.199682 dv-cinder-master-3-smb devstack@n-api.service[110137]: your server socket listen backlog is limited to 100 connections Oct 24 08:38:51.199682 dv-cinder-master-3-smb devstack@n-api.service[110137]: your mercy for graceful operations on workers is 90 seconds Oct 24 08:38:51.200179 dv-cinder-master-3-smb devstack@n-api.service[110137]: mapped 403077 bytes (393 KB) for 2 cores Oct 24 08:38:51.200179 dv-cinder-master-3-smb devstack@n-api.service[110137]: *** Operational MODE: preforking *** Oct 24 08:38:51.200312 dv-cinder-master-3-smb devstack@n-api.service[110137]: *** uWSGI is running in multiple interpreter mode *** Oct 24 08:38:51.200312 dv-cinder-master-3-smb devstack@n-api.service[110137]: spawned uWSGI master process (pid: 110137) Oct 24 08:38:51.200533 dv-cinder-master-3-smb systemd[1]: Started Devstack devstack@n-api.service. Oct 24 08:38:51.201617 dv-cinder-master-3-smb devstack@n-api.service[110137]: spawned uWSGI worker 1 (pid: 110138, cores: 1) Oct 24 08:38:51.201617 dv-cinder-master-3-smb devstack@n-api.service[110137]: spawned uWSGI worker 2 (pid: 110139, cores: 1) Oct 24 08:38:51.201617 dv-cinder-master-3-smb devstack@n-api.service[110137]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 24 08:38:51.847777 dv-cinder-master-3-smb devstack@n-api.service[110138]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 24 08:38:51.848422 dv-cinder-master-3-smb devstack@n-api.service[110139]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 24 08:38:52.908515 dv-cinder-master-3-smb devstack@n-api.service[110139]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 08:38:52.908515 dv-cinder-master-3-smb devstack@n-api.service[110139]: from cryptography.utils import int_from_bytes Oct 24 08:38:52.909276 dv-cinder-master-3-smb devstack@n-api.service[110138]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 08:38:52.909276 dv-cinder-master-3-smb devstack@n-api.service[110138]: from cryptography.utils import int_from_bytes Oct 24 08:38:52.909276 dv-cinder-master-3-smb devstack@n-api.service[110138]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 08:38:52.909276 dv-cinder-master-3-smb devstack@n-api.service[110138]: from cryptography.utils import int_from_bytes Oct 24 08:38:52.909779 dv-cinder-master-3-smb devstack@n-api.service[110139]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 08:38:52.909779 dv-cinder-master-3-smb devstack@n-api.service[110139]: from cryptography.utils import int_from_bytes Oct 24 08:38:55.377460 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 24 08:38:55.378113 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 24 08:38:55.378201 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 24 08:38:55.378574 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 24 08:38:55.378708 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 24 08:38:55.379135 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 24 08:38:55.379229 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 24 08:38:55.379305 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.379514 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 24 08:38:55.379647 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.379782 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.379884 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 24 08:38:55.380086 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 24 08:38:55.380185 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.380405 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.380515 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.380741 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.380897 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.381031 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.381141 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.381364 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.381516 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.381655 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.381752 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.381941 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.382073 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.382247 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.382379 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.382565 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.382745 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.382878 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.382983 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.383164 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.383308 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.383476 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.383607 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.383791 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.383934 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.384069 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.384177 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.384390 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.384531 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.384685 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.384776 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.384982 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.385186 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.385342 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.385661 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.385780 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.385948 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.386079 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.386288 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.386402 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.386617 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.386764 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.386932 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.387090 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.387296 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.387431 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.387553 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.387665 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.387854 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.387988 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.388168 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.388303 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.388440 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.388573 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.388789 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.388918 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.389103 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.389243 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.389377 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.389502 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.389730 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.389858 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.390078 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.390206 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.390384 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.390601 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.390770 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.390909 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.391033 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.391156 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.391358 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.391483 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.391647 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.391778 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.391976 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.392105 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.392298 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.392445 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.392577 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.392699 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.392888 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.393018 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.393172 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.393311 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.393499 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.393629 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.393781 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.393912 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.394092 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.394232 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.394358 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.394480 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.394666 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.394831 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.394962 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.395094 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.395219 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.395355 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.395528 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.395659 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.395789 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.395918 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.396088 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.396229 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.396360 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.396482 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.396618 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.396743 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.396866 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.396988 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.397196 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.397354 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.397559 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.397687 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.397809 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.397931 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.398073 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.398199 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.398328 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.398453 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.398606 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.398778 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.398915 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.399040 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.399228 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.399358 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.399534 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.399755 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.399993 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.400131 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.400255 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.400390 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.400513 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.400724 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.400864 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.401008 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.401131 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.401252 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.401381 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.401502 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.401685 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.401814 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.401953 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.402076 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.402302 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.402445 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.402576 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.402706 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.402930 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.403058 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.403252 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.403395 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.403527 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.403649 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.403840 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.403980 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.404133 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.404271 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.404446 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.404576 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.404752 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.404880 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.405032 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.405177 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.405330 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.405460 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.405588 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.405717 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.405855 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.405978 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.406152 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.406283 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.406460 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.406613 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.406822 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.406949 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.407077 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.407215 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.407337 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.407459 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.407679 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.407814 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.407940 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.408064 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.408185 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.408306 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.408499 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.408629 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.408752 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.408886 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.409049 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.409194 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.409349 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.409478 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.409653 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.409782 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.409957 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.410102 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.410240 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.410363 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.410520 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.410657 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.410870 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.411016 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.411142 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.411265 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.411386 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.411508 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.411714 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.411854 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.411985 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.412118 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.412293 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.412423 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.412574 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.412716 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.412849 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.412973 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.413170 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.413301 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.413475 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.413614 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.413768 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.413902 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.414074 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.414205 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.414380 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.414909 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.415037 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.415159 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.415343 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.415482 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.415613 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.415743 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.415923 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.416062 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.416216 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.416355 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.416586 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.416716 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.416870 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.417002 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.417176 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.417323 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.417460 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.417583 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.417790 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.417915 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.418037 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.418167 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.418308 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.418434 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.418611 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.418764 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.418901 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.419055 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.419194 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.419372 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.419504 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.419678 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.419808 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.420001 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.420139 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.420292 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.420423 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.420609 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.420734 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.420882 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.421078 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.421208 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.421331 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.421484 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.421620 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.421810 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:38:55.421941 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.422134 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.422265 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.422450 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.422579 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.422798 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.422944 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.423098 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.423226 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.423429 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.423566 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.423742 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.423951 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.424088 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.424221 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.424355 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.424486 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.424610 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.424742 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.424935 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.425065 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.425242 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.425383 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.425538 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.425669 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.425847 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.425996 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.426130 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.426261 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.426455 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.426585 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.426786 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.426917 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.427099 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.427239 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.427393 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.427521 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.427713 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.427927 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.428057 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.428189 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.428325 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.428449 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.428625 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.428764 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.428929 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.429066 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.429240 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.429370 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.429566 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.429703 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.429870 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.429999 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.430195 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.430325 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.430502 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.430642 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.430822 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.430954 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.431166 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.431298 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.431423 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.431545 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.431712 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.431842 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.432078 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.432206 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.432368 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.432505 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.432687 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.432817 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.432998 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.433139 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.433293 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.433432 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.433606 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.433741 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.433894 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.434026 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.434207 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.434344 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.434521 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.434649 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.434809 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.434932 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.435127 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.435270 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.435450 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.435590 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.435767 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.435895 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.436059 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.436199 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.436374 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.436502 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.436676 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.436806 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.436968 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.437096 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.437281 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.437410 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.437580 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.437707 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.437867 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.438078 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.438206 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.438328 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.438450 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.438571 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.438755 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.438889 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.439095 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.439221 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.439345 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.439474 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.439655 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.439786 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.439973 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.440103 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.440238 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.440370 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.440575 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.440703 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.440864 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.440985 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.441175 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.441388 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.441516 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.441638 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.441767 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.441895 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.442028 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.442160 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.442325 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.442453 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.442628 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.442770 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.442959 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.443096 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.443264 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.443390 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.443568 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.443695 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.443867 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.443994 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.444168 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.444295 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.444468 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.444594 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.444768 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.444901 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.445069 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.445198 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.445369 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.445495 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.445673 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.445799 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.445976 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.446103 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.446278 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.446403 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.446585 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.446765 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.446893 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.447014 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.447197 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.447338 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.447523 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.447659 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.447894 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.448028 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.448235 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.448431 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.448558 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.448681 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.448804 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.448924 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.449083 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.449220 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.449378 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.449503 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.449674 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.449808 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.449976 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.450112 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.450267 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.450432 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.450559 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.450681 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.450865 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.451075 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.451202 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.451323 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.451525 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.451663 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.451797 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.451922 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.452043 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.452173 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.452297 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.452418 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.452584 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.452713 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.452886 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.453022 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.453182 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.453310 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.453478 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.453606 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.453772 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.453911 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.454103 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.454249 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.454400 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.454536 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.454759 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.454901 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.455061 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.455199 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.455368 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.455493 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.455675 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.455800 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.455979 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.456116 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.456284 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.456409 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.456588 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.456714 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.456892 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.457027 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.457193 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.457328 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.457494 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.457621 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.457804 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.457941 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.458106 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.458248 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.458444 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.458569 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.458704 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.458854 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.459030 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.459171 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.459333 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.459461 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.459643 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.459779 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.459946 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.460073 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.460255 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.460382 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.460584 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.460713 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.460907 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.461035 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.461214 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.461352 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.461569 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.461712 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.461836 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.461956 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.462120 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.462259 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.462420 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.462553 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.462771 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.462900 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.463035 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.463167 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.463361 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.463492 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.463670 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.463807 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.463972 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.464110 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.464277 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.464410 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.464580 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.464708 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.464890 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.465033 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.465187 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.465312 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.465493 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.465619 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.465785 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.465920 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.466089 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.466216 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.466406 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.466541 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.466709 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.466871 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.467039 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.467164 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.467341 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.467468 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.467644 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.467780 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.467944 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.468069 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.468245 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.468369 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.468584 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.468711 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.468833 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.468964 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.469112 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.469248 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.469410 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.469537 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.469713 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.469840 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.470014 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.470155 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.470312 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.470437 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.470609 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.470759 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.470929 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.471068 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.471227 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.471365 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.471519 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.471660 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.471848 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.471986 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.472110 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.472231 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.472401 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.472527 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.472702 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.472837 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.473013 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.473145 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.473316 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.473442 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.473610 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.473735 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.473907 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.474036 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.474206 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.474331 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.474506 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.474643 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.474807 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.474949 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.475106 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.475233 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.475401 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.475541 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.475719 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.475858 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.476019 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.476145 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.476347 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.476485 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.476609 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.476731 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.476906 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.477042 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.477208 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.477334 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.477509 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.477634 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.477810 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.477944 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.478112 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.478246 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.478413 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.478552 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.478756 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.478921 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.479078 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.479203 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.479371 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.479499 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.479675 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.479818 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.479985 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.480113 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.480288 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.480413 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.480596 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.480723 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.480894 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.481027 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.481192 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.481318 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.481491 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.481623 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.481788 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.481991 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.482117 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.482362 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.482499 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.482684 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.482961 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.483088 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.483285 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.483413 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.483592 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.483720 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.483901 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.484046 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.484232 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.484369 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.484544 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.484672 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.484849 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.484977 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.485154 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.485286 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.485458 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.485583 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.485748 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.485873 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.486044 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.486172 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.486343 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.486472 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.486640 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.486806 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.486968 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.487104 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.487263 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.487400 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.487562 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.487696 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.487858 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.487991 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.488156 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.488292 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.488451 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.488576 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.488786 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.488928 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.489052 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.489187 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.489312 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.489442 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.489616 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.489746 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.489913 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.490047 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.490216 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.490341 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.490514 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.490642 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.490836 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.490964 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.491137 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.491264 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.491436 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.491560 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.491735 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.491864 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.492068 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.492203 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.492366 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.492495 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.492665 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.492793 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.492995 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.493130 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.493302 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.493427 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.493604 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.493732 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.493922 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.494050 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.494219 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.494353 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.494540 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.494669 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.494868 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.494996 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.495166 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.495307 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.495462 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.495599 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.495760 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.495893 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.496057 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.496191 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.496351 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.496485 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.496653 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.496777 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.496952 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.497092 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.497248 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.497382 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.497546 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.497671 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.497841 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.497970 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.498140 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.498267 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.498434 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.498561 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.498769 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.498976 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.499116 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.499247 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.499370 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.499492 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.499696 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.499870 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.500115 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.500246 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.500377 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.500503 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.500638 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.500762 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.500884 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.501006 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.501128 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.501261 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.501385 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.501508 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.501620 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.501747 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.501908 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.502045 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.502262 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.502393 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.502507 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.502638 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.502787 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.502921 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.503071 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.503199 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.503386 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.503515 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.503688 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.503824 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.503985 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.504113 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.504281 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.504409 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.504581 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.504717 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.504881 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.505008 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.505184 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.505310 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.505490 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.505619 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.505802 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.505929 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.506103 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.506236 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.506400 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.506534 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.506696 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.506844 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.507014 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.507148 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.507312 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.507442 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.507607 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.507733 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.507902 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.508038 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.508194 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.508319 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.508488 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.508621 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.508779 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.508913 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.509123 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.509251 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.509372 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.509494 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.509657 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.509794 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.510456 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.510580 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.510704 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.510882 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.510882 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.511128 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.511253 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.511375 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.511506 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.511630 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.511761 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.511892 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.512023 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.512146 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.512282 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.512473 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.512608 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.512744 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.512867 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.512998 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.513121 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.513242 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.513373 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.513496 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.513617 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.513739 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.513862 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.513984 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.514146 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.514275 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.514449 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.514576 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.514771 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.514920 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.515072 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.515200 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.515367 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.515494 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.515673 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.515808 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.515976 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.516109 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.516278 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.516413 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.516581 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.516720 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.516878 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.517004 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.517183 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.517311 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.517479 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.517613 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.517781 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.517906 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.518082 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.518207 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.518384 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.518522 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.518686 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.518856 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.519011 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.519163 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.519363 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.519495 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.519630 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.519753 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.519884 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.520006 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.520184 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.520312 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.520482 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.520607 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.520781 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.520909 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.521077 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.521210 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.521379 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.521504 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.521678 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.521806 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.521973 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.522099 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.522274 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.522401 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.522600 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.522757 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.522884 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.523007 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.523165 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.523295 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.523467 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.523605 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.523764 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.523891 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.524167 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.524298 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.524468 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.524634 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.524760 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.524880 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.525057 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.525185 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.525362 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.525514 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.525660 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.525812 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.525981 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.526106 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.526286 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.526413 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.526586 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.526763 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.527000 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.527138 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.527348 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.527475 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.527597 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.527719 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.527856 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.527979 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.528161 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.528296 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.528459 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.528586 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.528759 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.528884 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.529056 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.529177 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.529399 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.529539 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.529662 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.529793 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.529917 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.530045 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.530226 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.530353 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.530527 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.530664 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.530863 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.530991 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.531245 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.531370 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.531563 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.531702 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.531864 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.531992 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.532231 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.532356 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.532546 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.532771 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.532908 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.533084 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.533219 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.533344 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.533467 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.533589 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.533746 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.533881 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.534039 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.534165 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.534342 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.534470 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.534645 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.534828 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.534955 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.535077 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.535266 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.535394 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.535565 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.535701 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.535868 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.535994 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.536164 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.536291 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.536471 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.536606 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.536782 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.536916 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.537086 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.537214 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.537420 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.537545 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.537775 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.537903 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.538088 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.538225 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.538387 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.538513 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.538691 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.538834 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.539013 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.539154 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.539317 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.539818 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.540009 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.540146 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.540270 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.540401 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.540537 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.540660 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.540835 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.540963 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.541140 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.541266 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.541483 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.541621 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.541792 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.541920 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.542097 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.542227 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.542390 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.542515 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.542683 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.542916 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.543061 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.543191 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.543316 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.543438 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.543583 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.543712 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.543897 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.544026 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.544203 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.544331 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.544505 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.544638 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.544815 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.544951 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.545112 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.545241 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.545409 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.545543 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.545709 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.545837 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.546005 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.546131 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.546302 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.546444 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.546599 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.546749 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.546955 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.547092 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.547251 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.547390 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.547560 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.547688 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.547874 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.548000 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.548191 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.548318 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.548491 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.548618 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.548809 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.548935 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.549114 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.549242 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.549423 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.549549 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.549726 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.549853 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.550070 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.550202 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.550326 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.550448 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.550610 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.550787 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.550927 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.551053 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.551219 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.551346 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.551514 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.551652 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.551811 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.551939 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.552124 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.552249 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.552372 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.552504 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.552668 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.552795 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.552999 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.553141 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.553266 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.553397 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.553550 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.553679 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.553844 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.553986 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.554140 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.554275 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.554439 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.554568 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.554751 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.554881 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.555051 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.555180 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.555345 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.555473 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.555668 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.555795 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.555962 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.556089 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.556274 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.556401 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.556575 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.556700 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.556880 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.557029 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.557212 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.557339 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.557519 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.557652 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.557825 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.557960 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.558130 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.558256 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.558434 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.558569 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.558753 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.558884 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.559068 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.559195 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.559373 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.559504 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.559681 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.559807 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.559993 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.560209 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.560343 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.560512 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.560799 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.560935 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.561116 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.561250 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.561423 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.561563 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.561729 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.561855 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.562035 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.562173 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.562339 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.562466 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.562643 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.562803 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.562975 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.563178 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.563320 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.563447 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.563571 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.563694 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.563860 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.563988 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.564207 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.564340 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.564492 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.564620 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.564809 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.564946 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.565116 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.565252 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.565425 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.565553 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.565731 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.565937 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.566063 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.566185 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.566321 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.566445 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.566657 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.566814 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.566988 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.567113 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.567292 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.567420 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.567597 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.567724 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.567901 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.568039 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.568206 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.568342 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.568510 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.568638 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.568814 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.568941 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.569119 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.569254 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.569422 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.569540 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.569727 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.569855 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.570031 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.570169 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.570376 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.570510 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.570636 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.570800 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.570966 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.571095 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.571279 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.571405 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.571587 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.571715 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.571896 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.572022 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.572204 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.572402 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.572538 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.572765 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.573061 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.573203 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.573391 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.573518 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.573681 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.573820 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.574000 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.574129 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.574308 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.574441 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.574613 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.574773 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.574950 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.575085 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.575250 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.575375 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.575555 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.575691 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.575852 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.575980 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.576146 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.576273 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.576446 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.576581 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.576742 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.576877 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.577038 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.577163 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.577346 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.577481 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.577643 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.577772 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.577955 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.578162 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.578299 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.578500 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.578788 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.578921 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.579128 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.579310 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.579452 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.579577 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.579743 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.579872 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.580044 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.580171 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.580360 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.580565 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.580693 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.580815 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.580939 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.581061 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.581245 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.581373 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.581549 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.581675 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.581848 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.581986 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.582148 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.582276 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.582444 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.582570 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.582824 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.582968 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.583133 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.583259 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.583471 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.583606 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.583731 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.583863 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.584017 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.584139 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.584319 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.584446 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.584616 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.584750 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.584914 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.585043 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.585211 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.585337 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.585507 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.585641 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.585808 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.585939 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.586093 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.586219 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.586386 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.586519 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.586683 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.586844 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.587001 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.587140 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.587303 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.587438 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.587598 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.587724 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.587896 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.588022 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.588192 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.588344 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.588522 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.588651 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.588833 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.588968 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.589147 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.589276 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.589442 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.589569 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.589736 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.589870 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.590044 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.590171 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.590342 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.590471 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.590674 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.590850 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.590978 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.591101 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.591267 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.591394 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.591567 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.591702 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.591871 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.591999 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.592207 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.592412 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.592549 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.592739 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.593035 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.593165 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.593372 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.593520 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.593717 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.593844 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.593990 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.594115 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.594292 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.594419 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.594626 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.594774 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.594923 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.595049 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.595226 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.595353 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.595532 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.595661 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.595837 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.595965 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.596140 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.596276 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.596443 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.596569 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.596746 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.596873 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.597048 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.597183 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.597350 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.597476 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.597653 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.597779 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.597953 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.598087 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.598253 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.598379 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.598554 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.598679 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.598877 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.599005 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.599179 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.599308 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.599482 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.599611 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.599789 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.599929 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.600094 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.600222 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.600405 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.600538 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.600788 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.600925 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.601049 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.601179 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.601309 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.601440 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.601604 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.601732 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.601906 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.602033 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.602209 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.602343 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.602513 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.602638 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.602835 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.602977 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.603142 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.603271 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.603444 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.603571 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.603774 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.604100 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.604241 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.604489 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.604746 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.604873 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.605057 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.605185 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.605373 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.605501 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.605690 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.605817 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.605997 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.606126 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.606313 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.606441 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.606628 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.606807 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.606956 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.607096 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.607269 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.607396 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.607572 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.607700 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.607895 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.608032 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.608212 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.608338 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.608513 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.608641 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.608813 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.608949 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.609113 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.609250 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.609412 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.609537 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.609710 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.609846 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.610013 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.610139 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.610313 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.610440 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.610613 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.610782 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.610995 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.611123 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.611247 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.611378 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.611511 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.611635 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.611794 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.611925 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.612089 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.612222 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.612386 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.612514 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.612679 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.612813 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.612980 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.613115 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.613275 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.613402 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.613572 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.613698 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.613900 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.614042 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.614169 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.614292 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.614422 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.614548 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.614749 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.614894 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.615041 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.615168 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.615336 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.615463 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.615629 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.615764 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.615924 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.616050 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.616219 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.616348 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.616513 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.616657 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.616920 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.617058 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.617182 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.617303 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.617436 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.617567 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.617744 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.617880 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.618048 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.618178 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.618361 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.618490 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.618668 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.618817 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.619001 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.619126 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.619307 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.619435 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.619638 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.619765 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.619950 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.620080 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.620261 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.620396 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.620565 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.620691 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.620866 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.621014 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.621203 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.621337 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.621461 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.621591 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.621748 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.621886 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.622052 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.622180 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.622351 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.622477 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.622668 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.622945 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.623073 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.623195 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.623317 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.623440 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.623593 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.623722 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.623907 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.624082 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.624258 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.624393 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.624530 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.624658 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.624809 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.624937 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.625112 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.625237 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.625415 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.625542 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.625714 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.625840 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.626018 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.626156 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.626318 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.626455 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.626623 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.626772 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.626957 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.627157 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.627286 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.627409 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.627533 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.627655 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.627841 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.627978 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.628153 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.628286 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.628469 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.628594 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.628771 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.628899 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.629086 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.629217 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.629397 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.629521 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.629732 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.629860 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.630037 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.630155 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.630345 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.630470 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.630650 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.630828 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.630974 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.631101 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.631237 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110139) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 24 08:38:55.631443 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.631580 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:38:55.631792 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 24 08:38:55.787386 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO dbcounter [None req-b27ff408-dd5b-40f9-8fe2-37bbc907ca92 None None] Registered counter for database nova_api Oct 24 08:38:55.787591 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO dbcounter [None req-0f1b2e0e-76d9-4d14-9f9c-7cc58aaed7fb None None] Registered counter for database nova_api Oct 24 08:38:55.809559 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG oslo_db.sqlalchemy.engines [None req-0f1b2e0e-76d9-4d14-9f9c-7cc58aaed7fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110138) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 08:38:55.811493 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG oslo_db.sqlalchemy.engines [None req-b27ff408-dd5b-40f9-8fe2-37bbc907ca92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110139) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 08:38:55.816432 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG dbcounter [-] [110138] Writer thread running {{(pid=110138) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 08:38:55.818514 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG dbcounter [-] [110139] Writer thread running {{(pid=110139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 08:38:55.872363 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.context [None req-0f1b2e0e-76d9-4d14-9f9c-7cc58aaed7fb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dfb1c4c1-9694-4501-9182-d459e78ba11f(cell1) {{(pid=110138) load_cells /opt/stack/nova/nova/context.py:464}} Oct 24 08:38:55.874043 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.context [None req-b27ff408-dd5b-40f9-8fe2-37bbc907ca92 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dfb1c4c1-9694-4501-9182-d459e78ba11f(cell1) {{(pid=110139) load_cells /opt/stack/nova/nova/context.py:464}} Oct 24 08:38:55.876241 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG oslo_concurrency.lockutils [None req-0f1b2e0e-76d9-4d14-9f9c-7cc58aaed7fb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:38:55.876711 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG oslo_concurrency.lockutils [None req-0f1b2e0e-76d9-4d14-9f9c-7cc58aaed7fb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:38:55.877866 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG oslo_concurrency.lockutils [None req-b27ff408-dd5b-40f9-8fe2-37bbc907ca92 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:38:55.878295 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG oslo_concurrency.lockutils [None req-0f1b2e0e-76d9-4d14-9f9c-7cc58aaed7fb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:38:55.878426 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG oslo_concurrency.lockutils [None req-b27ff408-dd5b-40f9-8fe2-37bbc907ca92 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:38:55.879035 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG oslo_concurrency.lockutils [None req-0f1b2e0e-76d9-4d14-9f9c-7cc58aaed7fb None None] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:38:55.879473 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG oslo_concurrency.lockutils [None req-0f1b2e0e-76d9-4d14-9f9c-7cc58aaed7fb None None] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:38:55.879958 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG oslo_concurrency.lockutils [None req-b27ff408-dd5b-40f9-8fe2-37bbc907ca92 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:38:55.880666 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG oslo_concurrency.lockutils [None req-b27ff408-dd5b-40f9-8fe2-37bbc907ca92 None None] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:38:55.881072 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG oslo_concurrency.lockutils [None req-b27ff408-dd5b-40f9-8fe2-37bbc907ca92 None None] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:38:55.881443 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG oslo_concurrency.lockutils [None req-0f1b2e0e-76d9-4d14-9f9c-7cc58aaed7fb None None] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:38:55.883114 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG oslo_concurrency.lockutils [None req-b27ff408-dd5b-40f9-8fe2-37bbc907ca92 None None] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110139) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:38:55.883460 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO dbcounter [None req-0f1b2e0e-76d9-4d14-9f9c-7cc58aaed7fb None None] Registered counter for database nova_cell0 Oct 24 08:38:55.885100 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO dbcounter [None req-b27ff408-dd5b-40f9-8fe2-37bbc907ca92 None None] Registered counter for database nova_cell0 Oct 24 08:38:55.887717 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO dbcounter [None req-0f1b2e0e-76d9-4d14-9f9c-7cc58aaed7fb None None] Registered counter for database nova_cell1 Oct 24 08:38:55.889180 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO dbcounter [None req-b27ff408-dd5b-40f9-8fe2-37bbc907ca92 None None] Registered counter for database nova_cell1 Oct 24 08:38:55.895665 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG oslo_db.sqlalchemy.engines [None req-0f1b2e0e-76d9-4d14-9f9c-7cc58aaed7fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110138) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 08:38:55.898171 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG oslo_db.sqlalchemy.engines [None req-0f1b2e0e-76d9-4d14-9f9c-7cc58aaed7fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110138) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 08:38:55.900208 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG oslo_db.sqlalchemy.engines [None req-b27ff408-dd5b-40f9-8fe2-37bbc907ca92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110139) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 08:38:55.901072 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG dbcounter [-] [110138] Writer thread running {{(pid=110138) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 08:38:55.904138 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG oslo_db.sqlalchemy.engines [None req-b27ff408-dd5b-40f9-8fe2-37bbc907ca92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110139) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 08:38:55.905664 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG dbcounter [-] [110139] Writer thread running {{(pid=110139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 08:38:56.040138 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG dbcounter [-] [110138] Writer thread running {{(pid=110138) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 08:38:56.043934 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG dbcounter [-] [110139] Writer thread running {{(pid=110139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 08:38:56.048974 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO dbcounter [None req-0f1b2e0e-76d9-4d14-9f9c-7cc58aaed7fb None None] Registered counter for database nova_cell0 Oct 24 08:38:56.052992 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO dbcounter [None req-b27ff408-dd5b-40f9-8fe2-37bbc907ca92 None None] Registered counter for database nova_cell0 Oct 24 08:38:56.056529 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG oslo_db.sqlalchemy.engines [None req-0f1b2e0e-76d9-4d14-9f9c-7cc58aaed7fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110138) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 08:38:56.061879 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG dbcounter [-] [110138] Writer thread running {{(pid=110138) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 08:38:56.062325 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG oslo_db.sqlalchemy.engines [None req-b27ff408-dd5b-40f9-8fe2-37bbc907ca92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110139) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 08:38:56.067511 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG dbcounter [-] [110139] Writer thread running {{(pid=110139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 08:38:56.397679 dv-cinder-master-3-smb devstack@n-api.service[110138]: WARNING keystonemiddleware.auth_token [None req-0f1b2e0e-76d9-4d14-9f9c-7cc58aaed7fb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 08:38:56.398396 dv-cinder-master-3-smb devstack@n-api.service[110139]: WARNING keystonemiddleware.auth_token [None req-b27ff408-dd5b-40f9-8fe2-37bbc907ca92 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 08:38:56.405012 dv-cinder-master-3-smb devstack@n-api.service[110138]: WARNING keystonemiddleware.auth_token [None req-0f1b2e0e-76d9-4d14-9f9c-7cc58aaed7fb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 08:38:56.405757 dv-cinder-master-3-smb devstack@n-api.service[110139]: WARNING keystonemiddleware.auth_token [None req-b27ff408-dd5b-40f9-8fe2-37bbc907ca92 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 08:38:56.746097 dv-cinder-master-3-smb devstack@n-api.service[110138]: WARNING keystonemiddleware.auth_token [None req-0f1b2e0e-76d9-4d14-9f9c-7cc58aaed7fb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 08:38:56.752519 dv-cinder-master-3-smb devstack@n-api.service[110138]: WARNING keystonemiddleware.auth_token [None req-0f1b2e0e-76d9-4d14-9f9c-7cc58aaed7fb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 08:38:56.756515 dv-cinder-master-3-smb devstack@n-api.service[110139]: WARNING keystonemiddleware.auth_token [None req-b27ff408-dd5b-40f9-8fe2-37bbc907ca92 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 08:38:56.757792 dv-cinder-master-3-smb devstack@n-api.service[110138]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bc457029c0 pid: 110138 (default app) Oct 24 08:38:56.759880 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-0f1b2e0e-76d9-4d14-9f9c-7cc58aaed7fb None None] Calling method '>' {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:38:56.761097 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-0f1b2e0e-76d9-4d14-9f9c-7cc58aaed7fb None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001748 Oct 24 08:38:56.761499 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Mon Oct 24 08:38:56 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:38:56.762521 dv-cinder-master-3-smb devstack@n-api.service[110139]: WARNING keystonemiddleware.auth_token [None req-b27ff408-dd5b-40f9-8fe2-37bbc907ca92 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 08:38:56.768150 dv-cinder-master-3-smb devstack@n-api.service[110139]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bc457029c0 pid: 110139 (default app) Oct 24 08:40:17.446305 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-0f1b2e0e-76d9-4d14-9f9c-7cc58aaed7fb None None] Calling method '>' {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:40:17.447347 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-0f1b2e0e-76d9-4d14-9f9c-7cc58aaed7fb None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Oct 24 08:40:17.447853 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 2/2] 10.222.0.26 () {54 vars in 931 bytes} [Mon Oct 24 08:40:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:40:17.470058 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG dbcounter [-] [110139] Writing DB stats nova_api:SELECT=3 {{(pid=110139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:17.471166 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG dbcounter [-] [110139] Writing DB stats nova_cell0:SELECT=3 {{(pid=110139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:17.472166 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG dbcounter [-] [110139] Writing DB stats nova_cell1:SELECT=3 {{(pid=110139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:17.472910 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG dbcounter [-] [110139] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:18.345928 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-0101fea4-fd98-4288-b649-928b096088c1 admin admin] Calling method '>' {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:40:18.378287 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.requestlog [None req-0101fea4-fd98-4288-b649-928b096088c1 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.920463 Oct 24 08:40:18.379009 dv-cinder-master-3-smb devstack@n-api.service[110139]: [pid: 110139|app: 0|req: 1/3] 10.222.0.26 () {60 vars in 1292 bytes} [Mon Oct 24 08:40:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:40:20.954073 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-0f1b2e0e-76d9-4d14-9f9c-7cc58aaed7fb None None] Calling method '>' {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:40:20.955531 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-0f1b2e0e-76d9-4d14-9f9c-7cc58aaed7fb None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001787 Oct 24 08:40:20.956245 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 3/4] 10.222.0.26 () {54 vars in 931 bytes} [Mon Oct 24 08:40:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:40:21.401552 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-f2ffed6c-a6c0-4ffc-8f83-a9ff2f33cf5a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0, "name": "cirros256", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "c1", "ram": 256}} {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:40:21.451226 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.requestlog [None req-f2ffed6c-a6c0-4ffc-8f83-a9ff2f33cf5a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.488605 Oct 24 08:40:21.451801 dv-cinder-master-3-smb devstack@n-api.service[110139]: [pid: 110139|app: 0|req: 2/5] 10.222.0.26 () {64 vars in 1283 bytes} [Mon Oct 24 08:40:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:40:21.465544 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG dbcounter [-] [110138] Writing DB stats nova_api:SELECT=3 {{(pid=110138) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:21.466368 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG dbcounter [-] [110138] Writing DB stats nova_cell1:SELECT=3 {{(pid=110138) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:21.468527 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG dbcounter [-] [110138] Writing DB stats nova_cell0:SELECT=3 {{(pid=110138) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:21.469063 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG dbcounter [-] [110138] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110138) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:21.677148 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-56b5661b-60e2-4c8c-82ee-c7ab63d0aa9c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:40:21.742659 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-56b5661b-60e2-4c8c-82ee-c7ab63d0aa9c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.282303 Oct 24 08:40:21.743280 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 4/6] 10.222.0.26 () {64 vars in 1336 bytes} [Mon Oct 24 08:40:21 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:40:24.304682 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-f2ffed6c-a6c0-4ffc-8f83-a9ff2f33cf5a admin admin] Calling method '>' {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:40:24.305695 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.requestlog [None req-f2ffed6c-a6c0-4ffc-8f83-a9ff2f33cf5a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Oct 24 08:40:24.306056 dv-cinder-master-3-smb devstack@n-api.service[110139]: [pid: 110139|app: 0|req: 3/7] 10.222.0.26 () {54 vars in 931 bytes} [Mon Oct 24 08:40:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:40:24.956124 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-ec6abab0-8c14-4597-8153-9c07e634e0fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d1", "ram": 512, "name": "ds512M", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 5, "vcpus": 1}} {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:40:25.001308 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-ec6abab0-8c14-4597-8153-9c07e634e0fe admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.688522 Oct 24 08:40:25.002135 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 5/8] 10.222.0.26 () {64 vars in 1283 bytes} [Mon Oct 24 08:40:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:40:25.017255 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-ac615702-9928-43de-ae4e-138a97f52f9c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:40:25.065247 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.requestlog [None req-ac615702-9928-43de-ae4e-138a97f52f9c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052175 Oct 24 08:40:25.065839 dv-cinder-master-3-smb devstack@n-api.service[110139]: [pid: 110139|app: 0|req: 4/9] 10.222.0.26 () {64 vars in 1336 bytes} [Mon Oct 24 08:40:25 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:40:27.675578 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-ec6abab0-8c14-4597-8153-9c07e634e0fe admin admin] Calling method '>' {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:40:27.676599 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-ec6abab0-8c14-4597-8153-9c07e634e0fe admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Oct 24 08:40:27.676993 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 6/10] 10.222.0.26 () {54 vars in 931 bytes} [Mon Oct 24 08:40:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:40:28.086259 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-6e6d9de5-bfaf-4d3f-930a-b9ccf3182355 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "rxtx_factor": 1.0, "id": "d2", "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:40:28.105051 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.requestlog [None req-6e6d9de5-bfaf-4d3f-930a-b9ccf3182355 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.421349 Oct 24 08:40:28.105651 dv-cinder-master-3-smb devstack@n-api.service[110139]: [pid: 110139|app: 0|req: 5/11] 10.222.0.26 () {64 vars in 1283 bytes} [Mon Oct 24 08:40:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:40:28.118158 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-0bf285f4-f466-400a-a0c9-479cf9f5708b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:40:28.148479 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-0bf285f4-f466-400a-a0c9-479cf9f5708b admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033484 Oct 24 08:40:28.150401 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 7/12] 10.222.0.26 () {64 vars in 1336 bytes} [Mon Oct 24 08:40:28 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:40:30.741753 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-6e6d9de5-bfaf-4d3f-930a-b9ccf3182355 admin admin] Calling method '>' {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:40:30.742671 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.requestlog [None req-6e6d9de5-bfaf-4d3f-930a-b9ccf3182355 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Oct 24 08:40:30.743250 dv-cinder-master-3-smb devstack@n-api.service[110139]: [pid: 110139|app: 0|req: 6/13] 10.222.0.26 () {54 vars in 931 bytes} [Mon Oct 24 08:40:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:40:31.147156 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-64272115-ac69-4445-8d46-c04a2d397dce admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "name": "ds2G", "id": "d3", "disk": 10, "ram": 2048, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:40:31.169226 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-64272115-ac69-4445-8d46-c04a2d397dce admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.419864 Oct 24 08:40:31.169960 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 8/14] 10.222.0.26 () {64 vars in 1283 bytes} [Mon Oct 24 08:40:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:40:31.182416 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-e4d1238d-932e-453b-9d10-408fecf2b428 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:40:31.212394 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.requestlog [None req-e4d1238d-932e-453b-9d10-408fecf2b428 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033851 Oct 24 08:40:31.213076 dv-cinder-master-3-smb devstack@n-api.service[110139]: [pid: 110139|app: 0|req: 7/15] 10.222.0.26 () {64 vars in 1336 bytes} [Mon Oct 24 08:40:31 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:40:33.942904 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-64272115-ac69-4445-8d46-c04a2d397dce admin admin] Calling method '>' {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:40:33.944339 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-64272115-ac69-4445-8d46-c04a2d397dce admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002075 Oct 24 08:40:33.944866 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 9/16] 10.222.0.26 () {54 vars in 931 bytes} [Mon Oct 24 08:40:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:40:34.433772 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-a6f3a385-121a-4b69-b56f-95275719947f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "ds4G", "rxtx_factor": 1.0, "swap": 0, "id": "d4", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "os-flavor-access:is_public": true}} {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:40:34.456238 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.requestlog [None req-a6f3a385-121a-4b69-b56f-95275719947f admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.503302 Oct 24 08:40:34.456836 dv-cinder-master-3-smb devstack@n-api.service[110139]: [pid: 110139|app: 0|req: 8/17] 10.222.0.26 () {64 vars in 1283 bytes} [Mon Oct 24 08:40:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:40:34.470601 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-f2a2ac62-cebc-47c7-af79-8464628d0582 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:40:34.497358 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-f2a2ac62-cebc-47c7-af79-8464628d0582 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030849 Oct 24 08:40:34.497919 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 10/18] 10.222.0.26 () {64 vars in 1336 bytes} [Mon Oct 24 08:40:34 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:40:37.132426 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-a6f3a385-121a-4b69-b56f-95275719947f admin admin] Calling method '>' {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:40:37.133617 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.requestlog [None req-a6f3a385-121a-4b69-b56f-95275719947f admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002029 Oct 24 08:40:37.134158 dv-cinder-master-3-smb devstack@n-api.service[110139]: [pid: 110139|app: 0|req: 9/19] 10.222.0.26 () {54 vars in 931 bytes} [Mon Oct 24 08:40:37 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:40:37.573593 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-6c86ee92-0b7a-48b3-9ec0-fdcb702e9beb admin admin] Calling method '>' {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:40:37.600117 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-6c86ee92-0b7a-48b3-9ec0-fdcb702e9beb admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.458122 Oct 24 08:40:37.600714 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 11/20] 10.222.0.26 () {60 vars in 1292 bytes} [Mon Oct 24 08:40:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:40:40.304133 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-a6f3a385-121a-4b69-b56f-95275719947f admin admin] Calling method '>' {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:40:40.305153 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.requestlog [None req-a6f3a385-121a-4b69-b56f-95275719947f admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Oct 24 08:40:40.305553 dv-cinder-master-3-smb devstack@n-api.service[110139]: [pid: 110139|app: 0|req: 10/21] 10.222.0.26 () {54 vars in 931 bytes} [Mon Oct 24 08:40:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:40:40.718870 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-6c3c04d5-8150-431f-9063-93b5754801ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "m1.tiny", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "vcpus": 1, "ram": 512, "os-flavor-access:is_public": true}} {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:40:40.740797 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-6c3c04d5-8150-431f-9063-93b5754801ba admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.428756 Oct 24 08:40:40.742393 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 12/22] 10.222.0.26 () {64 vars in 1283 bytes} [Mon Oct 24 08:40:40 2022] POST /compute/v2.1/flavors => generated 402 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:40:40.753757 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-5dced677-8c9c-4d30-95b7-81186b049925 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:40:40.782423 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.requestlog [None req-5dced677-8c9c-4d30-95b7-81186b049925 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032378 Oct 24 08:40:40.783040 dv-cinder-master-3-smb devstack@n-api.service[110139]: [pid: 110139|app: 0|req: 11/23] 10.222.0.26 () {64 vars in 1333 bytes} [Mon Oct 24 08:40:40 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:40:43.358127 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-6c3c04d5-8150-431f-9063-93b5754801ba admin admin] Calling method '>' {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:40:43.359228 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-6c3c04d5-8150-431f-9063-93b5754801ba admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Oct 24 08:40:43.359626 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 931 bytes} [Mon Oct 24 08:40:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:40:43.710338 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-1dd93ddc-74fb-45cf-95bb-cbb01d1a3f29 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "swap": 0, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "disk": 20, "ram": 2048, "os-flavor-access:is_public": true}} {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:40:43.731760 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.requestlog [None req-1dd93ddc-74fb-45cf-95bb-cbb01d1a3f29 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.365739 Oct 24 08:40:43.732323 dv-cinder-master-3-smb devstack@n-api.service[110139]: [pid: 110139|app: 0|req: 12/25] 10.222.0.26 () {64 vars in 1283 bytes} [Mon Oct 24 08:40:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:40:43.744707 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-b85b6f30-b498-4511-848b-cc92a3d8c0b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:40:43.769959 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-b85b6f30-b498-4511-848b-cc92a3d8c0b4 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028907 Oct 24 08:40:43.770983 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 14/26] 10.222.0.26 () {64 vars in 1333 bytes} [Mon Oct 24 08:40:43 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:40:46.384522 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-1dd93ddc-74fb-45cf-95bb-cbb01d1a3f29 admin admin] Calling method '>' {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:40:46.385543 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.requestlog [None req-1dd93ddc-74fb-45cf-95bb-cbb01d1a3f29 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Oct 24 08:40:46.385941 dv-cinder-master-3-smb devstack@n-api.service[110139]: [pid: 110139|app: 0|req: 13/27] 10.222.0.26 () {54 vars in 931 bytes} [Mon Oct 24 08:40:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:40:46.808225 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-88e92de5-5829-45c3-a6de-9a88c998d2ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "id": "3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "ram": 4096}} {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:40:46.829780 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-88e92de5-5829-45c3-a6de-9a88c998d2ad admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.437284 Oct 24 08:40:46.834759 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 15/28] 10.222.0.26 () {64 vars in 1283 bytes} [Mon Oct 24 08:40:46 2022] POST /compute/v2.1/flavors => generated 406 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:40:46.842654 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-f6de0a1f-a565-472c-a35b-48c91c20afaa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:40:46.874191 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.requestlog [None req-f6de0a1f-a565-472c-a35b-48c91c20afaa admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035287 Oct 24 08:40:46.875023 dv-cinder-master-3-smb devstack@n-api.service[110139]: [pid: 110139|app: 0|req: 14/29] 10.222.0.26 () {64 vars in 1333 bytes} [Mon Oct 24 08:40:46 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:40:49.485075 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-88e92de5-5829-45c3-a6de-9a88c998d2ad admin admin] Calling method '>' {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:40:49.485075 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-88e92de5-5829-45c3-a6de-9a88c998d2ad admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001581 Oct 24 08:40:49.485075 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 16/30] 10.222.0.26 () {54 vars in 931 bytes} [Mon Oct 24 08:40:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:40:49.985104 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-cfd90ba7-1a87-4af0-982b-ae98bcf3468d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "ram": 8192, "id": "4", "name": "m1.large", "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:40:49.992668 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG dbcounter [-] [110139] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:50.014018 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.requestlog [None req-cfd90ba7-1a87-4af0-982b-ae98bcf3468d admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.522322 Oct 24 08:40:50.014934 dv-cinder-master-3-smb devstack@n-api.service[110139]: [pid: 110139|app: 0|req: 15/31] 10.222.0.26 () {64 vars in 1283 bytes} [Mon Oct 24 08:40:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:40:50.026843 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-b543bdb5-9470-44a6-b9d1-f1b206165297 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:40:50.052607 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-b543bdb5-9470-44a6-b9d1-f1b206165297 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029432 Oct 24 08:40:50.053539 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 17/32] 10.222.0.26 () {64 vars in 1333 bytes} [Mon Oct 24 08:40:50 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:40:52.653855 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-cfd90ba7-1a87-4af0-982b-ae98bcf3468d admin admin] Calling method '>' {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:40:52.654938 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.requestlog [None req-cfd90ba7-1a87-4af0-982b-ae98bcf3468d admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Oct 24 08:40:52.655488 dv-cinder-master-3-smb devstack@n-api.service[110139]: [pid: 110139|app: 0|req: 16/33] 10.222.0.26 () {54 vars in 931 bytes} [Mon Oct 24 08:40:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:40:53.083512 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-beca9d25-fe9e-4723-9433-3ce1257b92a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "vcpus": 8, "disk": 160, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "5", "rxtx_factor": 1.0, "swap": 0}} {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:40:53.091112 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG dbcounter [-] [110138] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=110138) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:53.109566 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-beca9d25-fe9e-4723-9433-3ce1257b92a2 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.448004 Oct 24 08:40:53.110427 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 18/34] 10.222.0.26 () {64 vars in 1283 bytes} [Mon Oct 24 08:40:52 2022] POST /compute/v2.1/flavors => generated 408 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:40:53.122430 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-6d012d3c-2880-4fda-88c7-ba1763342151 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:40:53.151282 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.requestlog [None req-6d012d3c-2880-4fda-88c7-ba1763342151 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032527 Oct 24 08:40:53.152163 dv-cinder-master-3-smb devstack@n-api.service[110139]: [pid: 110139|app: 0|req: 17/35] 10.222.0.26 () {64 vars in 1333 bytes} [Mon Oct 24 08:40:53 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:41:09.613499 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-beca9d25-fe9e-4723-9433-3ce1257b92a2 admin admin] Calling method '>' {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:41:09.615210 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-beca9d25-fe9e-4723-9433-3ce1257b92a2 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002411 Oct 24 08:41:09.615801 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 19/36] 10.222.0.26 () {54 vars in 931 bytes} [Mon Oct 24 08:41:09 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:41:09.633071 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG dbcounter [-] [110139] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=110139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:10.051749 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-20343d15-0b6b-435e-a2f1-0a2d5a8d7594 admin admin] Calling method '>' {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:41:10.069818 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.requestlog [None req-20343d15-0b6b-435e-a2f1-0a2d5a8d7594 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.444099 Oct 24 08:41:10.070362 dv-cinder-master-3-smb devstack@n-api.service[110139]: [pid: 110139|app: 0|req: 18/37] 10.222.0.26 () {60 vars in 1292 bytes} [Mon Oct 24 08:41:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:41:11.390786 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-beca9d25-fe9e-4723-9433-3ce1257b92a2 admin admin] Calling method '>' {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:41:11.391817 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-beca9d25-fe9e-4723-9433-3ce1257b92a2 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Oct 24 08:41:11.392214 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 20/38] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Oct 24 08:41:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:41:11.931387 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-37c296e3-a33e-4af7-ada0-8b11e598e0c6 admin admin] Calling method '>' {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:41:11.936858 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.wsgi [None req-37c296e3-a33e-4af7-ada0-8b11e598e0c6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 24 08:41:11.940132 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-37c296e3-a33e-4af7-ada0-8b11e598e0c6 admin admin] Request method failure captured: Oct 24 08:41:11.940132 dv-cinder-master-3-smb devstack@n-api.service[110139]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 24 08:41:11.940132 dv-cinder-master-3-smb devstack@n-api.service[110139]: Accept: application/json Oct 24 08:41:11.940132 dv-cinder-master-3-smb devstack@n-api.service[110139]: Accept-Encoding: gzip, deflate Oct 24 08:41:11.940132 dv-cinder-master-3-smb devstack@n-api.service[110139]: Connection: keep-alive Oct 24 08:41:11.940132 dv-cinder-master-3-smb devstack@n-api.service[110139]: Content-Length: 0 Oct 24 08:41:11.940132 dv-cinder-master-3-smb devstack@n-api.service[110139]: Host: 10.222.0.26 Oct 24 08:41:11.940132 dv-cinder-master-3-smb devstack@n-api.service[110139]: Openstack-Api-Version: compute 2.92 Oct 24 08:41:11.940132 dv-cinder-master-3-smb devstack@n-api.service[110139]: Openstack-System-Scope: None Oct 24 08:41:11.940132 dv-cinder-master-3-smb devstack@n-api.service[110139]: User-Agent: python-novaclient Oct 24 08:41:11.940132 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Auth-Token: gAAAAABjVk-nSHzbiPpCrvXR_NpFoBiQzQcts68BjzvALI85fPMYRHxJ1i_-fsk2_QTNzmMI2w-FvcSf9_kOkz_FzURL4xlODl3sF0DrU_TPEvsM4Oev-G3HvZaCkRpHsDtDLhMnXCKyucECXAmf-fp7dpeY7R4fFwVQOPzMggmJXrhl66ZW7Gc Oct 24 08:41:11.940132 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Domain-Id: None Oct 24 08:41:11.940132 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Domain-Name: None Oct 24 08:41:11.940132 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Identity-Status: Confirmed Oct 24 08:41:11.940132 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Is-Admin-Project: True Oct 24 08:41:11.940132 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Openstack-Nova-Api-Version: 2.92 Oct 24 08:41:11.940132 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Project-Domain-Id: default Oct 24 08:41:11.940132 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Project-Domain-Name: Default Oct 24 08:41:11.940132 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Project-Id: d2f48107e8bb4875908f0d6dc2693154 Oct 24 08:41:11.940132 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Project-Name: admin Oct 24 08:41:11.940132 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Role: admin,member,reader Oct 24 08:41:11.940132 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Roles: admin,member,reader Oct 24 08:41:11.941738 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d2f48107e8bb4875908f0d6dc2693154", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d2f48107e8bb4875908f0d6dc2693154"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d2f48107e8bb4875908f0d6dc2693154"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d2f48107e8bb4875908f0d6dc2693154"}]}] Oct 24 08:41:11.941738 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Tenant: admin Oct 24 08:41:11.941738 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Tenant-Id: d2f48107e8bb4875908f0d6dc2693154 Oct 24 08:41:11.941738 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Tenant-Name: admin Oct 24 08:41:11.941738 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-User: admin Oct 24 08:41:11.941738 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-User-Domain-Id: default Oct 24 08:41:11.941738 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-User-Domain-Name: Default Oct 24 08:41:11.941738 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-User-Id: 2e8c1f674ea94c1eb2d8a47d1aad00af Oct 24 08:41:11.941738 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-User-Name: admin Oct 24 08:41:11.941738 dv-cinder-master-3-smb devstack@n-api.service[110139]: method: > Oct 24 08:41:11.941738 dv-cinder-master-3-smb devstack@n-api.service[110139]: exception: Flavor 42 could not be found. Oct 24 08:41:11.941738 dv-cinder-master-3-smb devstack@n-api.service[110139]: action_args: {'id': '42'} Oct 24 08:41:11.941738 dv-cinder-master-3-smb devstack@n-api.service[110139]: {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:41:11.941738 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:41:11.942757 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 24 08:41:11.942757 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 24 08:41:11.942757 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 08:41:11.942757 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 08:41:11.942757 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 08:41:11.942757 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 08:41:11.942757 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 08:41:11.942757 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 08:41:11.942757 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 08:41:11.942757 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:41:11.942757 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 08:41:11.942757 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 08:41:11.942757 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 24 08:41:11.942757 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi Oct 24 08:41:11.942757 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:41:11.942757 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi Oct 24 08:41:11.942757 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:41:11.942757 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:41:11.942757 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:41:11.943924 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:41:11.943924 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:41:11.943924 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:41:11.943924 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:41:11.943924 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 24 08:41:11.943924 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:41:11.943924 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 24 08:41:11.943924 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi Oct 24 08:41:11.943924 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:41:11.943924 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi Oct 24 08:41:11.943924 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:41:11.943924 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:41:11.943924 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:41:11.943924 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:41:11.943924 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:41:11.943924 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 24 08:41:11.943924 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi Oct 24 08:41:11.943924 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-37c296e3-a33e-4af7-ada0-8b11e598e0c6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110139) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:41:11.945086 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.requestlog [None req-37c296e3-a33e-4af7-ada0-8b11e598e0c6 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.411436 Oct 24 08:41:11.945086 dv-cinder-master-3-smb devstack@n-api.service[110139]: [pid: 110139|app: 0|req: 19/39] 10.222.0.26 () {60 vars in 1190 bytes} [Mon Oct 24 08:41:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 413 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 24 08:41:11.951611 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-d379c7ef-3151-46e1-ac51-9a574c69f30b admin admin] Calling method '>' {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:41:11.974798 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-d379c7ef-3151-46e1-ac51-9a574c69f30b admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026855 Oct 24 08:41:11.975358 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 21/40] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Oct 24 08:41:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:41:11.986397 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-24b29171-e155-4904-8318-26cded120813 admin admin] Calling method '>' {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:41:12.008275 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.requestlog [None req-24b29171-e155-4904-8318-26cded120813 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026489 Oct 24 08:41:12.008809 dv-cinder-master-3-smb devstack@n-api.service[110139]: [pid: 110139|app: 0|req: 20/41] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Oct 24 08:41:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:41:12.019186 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-5b3b3ae0-d194-400f-860b-33cdca6ca0f9 admin admin] Calling method '>' {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:41:12.024783 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.wsgi [None req-5b3b3ae0-d194-400f-860b-33cdca6ca0f9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 24 08:41:12.028157 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-5b3b3ae0-d194-400f-860b-33cdca6ca0f9 admin admin] Request method failure captured: Oct 24 08:41:12.028157 dv-cinder-master-3-smb devstack@n-api.service[110138]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 24 08:41:12.028157 dv-cinder-master-3-smb devstack@n-api.service[110138]: Accept: application/json Oct 24 08:41:12.028157 dv-cinder-master-3-smb devstack@n-api.service[110138]: Accept-Encoding: gzip, deflate Oct 24 08:41:12.028157 dv-cinder-master-3-smb devstack@n-api.service[110138]: Connection: keep-alive Oct 24 08:41:12.028157 dv-cinder-master-3-smb devstack@n-api.service[110138]: Content-Length: 0 Oct 24 08:41:12.028157 dv-cinder-master-3-smb devstack@n-api.service[110138]: Host: 10.222.0.26 Oct 24 08:41:12.028157 dv-cinder-master-3-smb devstack@n-api.service[110138]: Openstack-Api-Version: compute 2.92 Oct 24 08:41:12.028157 dv-cinder-master-3-smb devstack@n-api.service[110138]: Openstack-System-Scope: None Oct 24 08:41:12.028157 dv-cinder-master-3-smb devstack@n-api.service[110138]: User-Agent: python-novaclient Oct 24 08:41:12.028157 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Auth-Token: gAAAAABjVk-nSHzbiPpCrvXR_NpFoBiQzQcts68BjzvALI85fPMYRHxJ1i_-fsk2_QTNzmMI2w-FvcSf9_kOkz_FzURL4xlODl3sF0DrU_TPEvsM4Oev-G3HvZaCkRpHsDtDLhMnXCKyucECXAmf-fp7dpeY7R4fFwVQOPzMggmJXrhl66ZW7Gc Oct 24 08:41:12.028157 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Domain-Id: None Oct 24 08:41:12.028157 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Domain-Name: None Oct 24 08:41:12.028157 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Identity-Status: Confirmed Oct 24 08:41:12.028157 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Is-Admin-Project: True Oct 24 08:41:12.028157 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Openstack-Nova-Api-Version: 2.92 Oct 24 08:41:12.028157 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Project-Domain-Id: default Oct 24 08:41:12.028157 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Project-Domain-Name: Default Oct 24 08:41:12.028157 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Project-Id: d2f48107e8bb4875908f0d6dc2693154 Oct 24 08:41:12.028157 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Project-Name: admin Oct 24 08:41:12.028157 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Role: admin,member,reader Oct 24 08:41:12.028157 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Roles: admin,member,reader Oct 24 08:41:12.029566 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d2f48107e8bb4875908f0d6dc2693154", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d2f48107e8bb4875908f0d6dc2693154"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d2f48107e8bb4875908f0d6dc2693154"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d2f48107e8bb4875908f0d6dc2693154"}]}] Oct 24 08:41:12.029566 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Tenant: admin Oct 24 08:41:12.029566 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Tenant-Id: d2f48107e8bb4875908f0d6dc2693154 Oct 24 08:41:12.029566 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Tenant-Name: admin Oct 24 08:41:12.029566 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-User: admin Oct 24 08:41:12.029566 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-User-Domain-Id: default Oct 24 08:41:12.029566 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-User-Domain-Name: Default Oct 24 08:41:12.029566 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-User-Id: 2e8c1f674ea94c1eb2d8a47d1aad00af Oct 24 08:41:12.029566 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-User-Name: admin Oct 24 08:41:12.029566 dv-cinder-master-3-smb devstack@n-api.service[110138]: method: > Oct 24 08:41:12.029566 dv-cinder-master-3-smb devstack@n-api.service[110138]: exception: Flavor 42 could not be found. Oct 24 08:41:12.029566 dv-cinder-master-3-smb devstack@n-api.service[110138]: action_args: {'id': '42'} Oct 24 08:41:12.029566 dv-cinder-master-3-smb devstack@n-api.service[110138]: {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:41:12.029566 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:41:12.030357 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 24 08:41:12.030357 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 24 08:41:12.030357 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 08:41:12.030357 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 08:41:12.030357 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 08:41:12.030357 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 08:41:12.030357 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 08:41:12.030357 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 08:41:12.030357 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 08:41:12.030357 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:41:12.030357 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 08:41:12.030357 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 08:41:12.030357 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 24 08:41:12.030357 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi Oct 24 08:41:12.030357 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:41:12.030357 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi Oct 24 08:41:12.030357 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:41:12.030357 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:41:12.030357 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:41:12.031748 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:41:12.031748 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:41:12.031748 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:41:12.031748 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:41:12.031748 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 24 08:41:12.031748 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:41:12.031748 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 24 08:41:12.031748 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi Oct 24 08:41:12.031748 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:41:12.031748 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi Oct 24 08:41:12.031748 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:41:12.031748 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:41:12.031748 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:41:12.031748 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:41:12.031748 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:41:12.031748 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 24 08:41:12.031748 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi Oct 24 08:41:12.031748 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-5b3b3ae0-d194-400f-860b-33cdca6ca0f9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:41:12.032974 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-5b3b3ae0-d194-400f-860b-33cdca6ca0f9 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014589 Oct 24 08:41:12.032974 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 22/42] 10.222.0.26 () {60 vars in 1190 bytes} [Mon Oct 24 08:41:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 24 08:41:13.238748 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-24b29171-e155-4904-8318-26cded120813 admin admin] Calling method '>' {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:41:13.239780 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.requestlog [None req-24b29171-e155-4904-8318-26cded120813 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Oct 24 08:41:13.240174 dv-cinder-master-3-smb devstack@n-api.service[110139]: [pid: 110139|app: 0|req: 21/43] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Oct 24 08:41:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:41:13.817043 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-892ec359-22ef-4256-a8d9-ecf27e3b6e3a admin admin] Calling method '>' {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:41:13.822178 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.wsgi [None req-892ec359-22ef-4256-a8d9-ecf27e3b6e3a admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 24 08:41:13.823736 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-892ec359-22ef-4256-a8d9-ecf27e3b6e3a admin admin] Request method failure captured: Oct 24 08:41:13.823736 dv-cinder-master-3-smb devstack@n-api.service[110138]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 24 08:41:13.823736 dv-cinder-master-3-smb devstack@n-api.service[110138]: Accept: application/json Oct 24 08:41:13.823736 dv-cinder-master-3-smb devstack@n-api.service[110138]: Accept-Encoding: gzip, deflate Oct 24 08:41:13.823736 dv-cinder-master-3-smb devstack@n-api.service[110138]: Connection: keep-alive Oct 24 08:41:13.823736 dv-cinder-master-3-smb devstack@n-api.service[110138]: Content-Length: 0 Oct 24 08:41:13.823736 dv-cinder-master-3-smb devstack@n-api.service[110138]: Host: 10.222.0.26 Oct 24 08:41:13.823736 dv-cinder-master-3-smb devstack@n-api.service[110138]: Openstack-Api-Version: compute 2.92 Oct 24 08:41:13.823736 dv-cinder-master-3-smb devstack@n-api.service[110138]: Openstack-System-Scope: None Oct 24 08:41:13.823736 dv-cinder-master-3-smb devstack@n-api.service[110138]: User-Agent: python-novaclient Oct 24 08:41:13.823736 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Auth-Token: gAAAAABjVk-poyf0nwcMSHOg-qB2sl31tl1HS94dm6wdaTy1vJ6tdqZ32WQk0KFqwQCCOxbnDg4CI7vcXGb_SSdrrNteXJ-9f_Qs9tfo3LYYjZFF21ij7zNzvCTu0NXLiWY9IEjc7mgCqepb8uc67r0aFkAHv3eNd6CCY8sNDPiIsuMnnNrlmfg Oct 24 08:41:13.823736 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Domain-Id: None Oct 24 08:41:13.823736 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Domain-Name: None Oct 24 08:41:13.823736 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Identity-Status: Confirmed Oct 24 08:41:13.823736 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Is-Admin-Project: True Oct 24 08:41:13.823736 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Openstack-Nova-Api-Version: 2.92 Oct 24 08:41:13.823736 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Project-Domain-Id: default Oct 24 08:41:13.823736 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Project-Domain-Name: Default Oct 24 08:41:13.823736 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Project-Id: d2f48107e8bb4875908f0d6dc2693154 Oct 24 08:41:13.823736 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Project-Name: admin Oct 24 08:41:13.823736 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Role: admin,member,reader Oct 24 08:41:13.823736 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Roles: admin,member,reader Oct 24 08:41:13.825321 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d2f48107e8bb4875908f0d6dc2693154", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d2f48107e8bb4875908f0d6dc2693154"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d2f48107e8bb4875908f0d6dc2693154"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d2f48107e8bb4875908f0d6dc2693154"}]}] Oct 24 08:41:13.825321 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Tenant: admin Oct 24 08:41:13.825321 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Tenant-Id: d2f48107e8bb4875908f0d6dc2693154 Oct 24 08:41:13.825321 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Tenant-Name: admin Oct 24 08:41:13.825321 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-User: admin Oct 24 08:41:13.825321 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-User-Domain-Id: default Oct 24 08:41:13.825321 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-User-Domain-Name: Default Oct 24 08:41:13.825321 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-User-Id: 2e8c1f674ea94c1eb2d8a47d1aad00af Oct 24 08:41:13.825321 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-User-Name: admin Oct 24 08:41:13.825321 dv-cinder-master-3-smb devstack@n-api.service[110138]: method: > Oct 24 08:41:13.825321 dv-cinder-master-3-smb devstack@n-api.service[110138]: exception: Flavor 84 could not be found. Oct 24 08:41:13.825321 dv-cinder-master-3-smb devstack@n-api.service[110138]: action_args: {'id': '84'} Oct 24 08:41:13.825321 dv-cinder-master-3-smb devstack@n-api.service[110138]: {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:41:13.825321 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:41:13.826171 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 24 08:41:13.826171 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 24 08:41:13.826171 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 08:41:13.826171 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 08:41:13.826171 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 08:41:13.826171 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 08:41:13.826171 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 08:41:13.826171 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 08:41:13.826171 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 08:41:13.826171 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:41:13.826171 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 08:41:13.826171 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 08:41:13.826171 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 24 08:41:13.826171 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi Oct 24 08:41:13.826171 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:41:13.826171 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi Oct 24 08:41:13.826171 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:41:13.826171 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:41:13.826171 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:41:13.827508 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:41:13.827508 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:41:13.827508 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:41:13.827508 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:41:13.827508 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 24 08:41:13.827508 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:41:13.827508 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 24 08:41:13.827508 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi Oct 24 08:41:13.827508 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:41:13.827508 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi Oct 24 08:41:13.827508 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:41:13.827508 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:41:13.827508 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:41:13.827508 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:41:13.827508 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:41:13.827508 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 24 08:41:13.827508 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi Oct 24 08:41:13.827508 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-892ec359-22ef-4256-a8d9-ecf27e3b6e3a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:41:13.828790 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-892ec359-22ef-4256-a8d9-ecf27e3b6e3a admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.447692 Oct 24 08:41:13.828790 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 23/44] 10.222.0.26 () {60 vars in 1190 bytes} [Mon Oct 24 08:41:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 449 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 24 08:41:13.835891 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-beecc974-da44-4f03-855a-986a4a870b0c admin admin] Calling method '>' {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:41:13.850936 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.requestlog [None req-beecc974-da44-4f03-855a-986a4a870b0c admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018717 Oct 24 08:41:13.851427 dv-cinder-master-3-smb devstack@n-api.service[110139]: [pid: 110139|app: 0|req: 22/45] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Oct 24 08:41:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:41:13.860940 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-d8cdd631-9382-42a0-971f-1ec187ed1fdd admin admin] Calling method '>' {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:41:13.876852 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-d8cdd631-9382-42a0-971f-1ec187ed1fdd admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019347 Oct 24 08:41:13.877392 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Oct 24 08:41:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:41:13.887918 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-099fc2ae-5960-419d-b259-57d1f64d1d43 admin admin] Calling method '>' {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:41:13.893070 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.wsgi [None req-099fc2ae-5960-419d-b259-57d1f64d1d43 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 24 08:41:13.894565 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-099fc2ae-5960-419d-b259-57d1f64d1d43 admin admin] Request method failure captured: Oct 24 08:41:13.894565 dv-cinder-master-3-smb devstack@n-api.service[110139]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 24 08:41:13.894565 dv-cinder-master-3-smb devstack@n-api.service[110139]: Accept: application/json Oct 24 08:41:13.894565 dv-cinder-master-3-smb devstack@n-api.service[110139]: Accept-Encoding: gzip, deflate Oct 24 08:41:13.894565 dv-cinder-master-3-smb devstack@n-api.service[110139]: Connection: keep-alive Oct 24 08:41:13.894565 dv-cinder-master-3-smb devstack@n-api.service[110139]: Content-Length: 0 Oct 24 08:41:13.894565 dv-cinder-master-3-smb devstack@n-api.service[110139]: Host: 10.222.0.26 Oct 24 08:41:13.894565 dv-cinder-master-3-smb devstack@n-api.service[110139]: Openstack-Api-Version: compute 2.92 Oct 24 08:41:13.894565 dv-cinder-master-3-smb devstack@n-api.service[110139]: Openstack-System-Scope: None Oct 24 08:41:13.894565 dv-cinder-master-3-smb devstack@n-api.service[110139]: User-Agent: python-novaclient Oct 24 08:41:13.894565 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Auth-Token: gAAAAABjVk-poyf0nwcMSHOg-qB2sl31tl1HS94dm6wdaTy1vJ6tdqZ32WQk0KFqwQCCOxbnDg4CI7vcXGb_SSdrrNteXJ-9f_Qs9tfo3LYYjZFF21ij7zNzvCTu0NXLiWY9IEjc7mgCqepb8uc67r0aFkAHv3eNd6CCY8sNDPiIsuMnnNrlmfg Oct 24 08:41:13.894565 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Domain-Id: None Oct 24 08:41:13.894565 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Domain-Name: None Oct 24 08:41:13.894565 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Identity-Status: Confirmed Oct 24 08:41:13.894565 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Is-Admin-Project: True Oct 24 08:41:13.894565 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Openstack-Nova-Api-Version: 2.92 Oct 24 08:41:13.894565 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Project-Domain-Id: default Oct 24 08:41:13.894565 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Project-Domain-Name: Default Oct 24 08:41:13.894565 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Project-Id: d2f48107e8bb4875908f0d6dc2693154 Oct 24 08:41:13.894565 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Project-Name: admin Oct 24 08:41:13.894565 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Role: admin,member,reader Oct 24 08:41:13.894565 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Roles: admin,member,reader Oct 24 08:41:13.896041 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d2f48107e8bb4875908f0d6dc2693154", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d2f48107e8bb4875908f0d6dc2693154"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d2f48107e8bb4875908f0d6dc2693154"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d2f48107e8bb4875908f0d6dc2693154"}]}] Oct 24 08:41:13.896041 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Tenant: admin Oct 24 08:41:13.896041 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Tenant-Id: d2f48107e8bb4875908f0d6dc2693154 Oct 24 08:41:13.896041 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Tenant-Name: admin Oct 24 08:41:13.896041 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-User: admin Oct 24 08:41:13.896041 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-User-Domain-Id: default Oct 24 08:41:13.896041 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-User-Domain-Name: Default Oct 24 08:41:13.896041 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-User-Id: 2e8c1f674ea94c1eb2d8a47d1aad00af Oct 24 08:41:13.896041 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-User-Name: admin Oct 24 08:41:13.896041 dv-cinder-master-3-smb devstack@n-api.service[110139]: method: > Oct 24 08:41:13.896041 dv-cinder-master-3-smb devstack@n-api.service[110139]: exception: Flavor 84 could not be found. Oct 24 08:41:13.896041 dv-cinder-master-3-smb devstack@n-api.service[110139]: action_args: {'id': '84'} Oct 24 08:41:13.896041 dv-cinder-master-3-smb devstack@n-api.service[110139]: {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:41:13.896041 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:41:13.897026 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 24 08:41:13.897026 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 24 08:41:13.897026 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 08:41:13.897026 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 08:41:13.897026 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 08:41:13.897026 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 08:41:13.897026 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 08:41:13.897026 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 08:41:13.897026 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 08:41:13.897026 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:41:13.897026 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 08:41:13.897026 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 08:41:13.897026 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 24 08:41:13.897026 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi Oct 24 08:41:13.897026 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:41:13.897026 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi Oct 24 08:41:13.897026 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:41:13.897026 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:41:13.897026 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:41:13.898264 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:41:13.898264 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:41:13.898264 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:41:13.898264 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:41:13.898264 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 24 08:41:13.898264 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:41:13.898264 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 24 08:41:13.898264 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi Oct 24 08:41:13.898264 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:41:13.898264 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi Oct 24 08:41:13.898264 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:41:13.898264 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:41:13.898264 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:41:13.898264 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:41:13.898264 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:41:13.898264 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 24 08:41:13.898264 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi Oct 24 08:41:13.898264 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-099fc2ae-5960-419d-b259-57d1f64d1d43 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110139) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:41:13.899491 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.requestlog [None req-099fc2ae-5960-419d-b259-57d1f64d1d43 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012301 Oct 24 08:41:13.899491 dv-cinder-master-3-smb devstack@n-api.service[110139]: [pid: 110139|app: 0|req: 23/47] 10.222.0.26 () {60 vars in 1190 bytes} [Mon Oct 24 08:41:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 24 08:41:15.108968 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-d8cdd631-9382-42a0-971f-1ec187ed1fdd admin admin] Calling method '>' {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:41:15.109976 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-d8cdd631-9382-42a0-971f-1ec187ed1fdd admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Oct 24 08:41:15.110364 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 25/48] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Oct 24 08:41:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:41:15.663391 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-d4c34081-b100-446f-99b0-2674f741c589 admin admin] Calling method '>' {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:41:15.669799 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.wsgi [None req-d4c34081-b100-446f-99b0-2674f741c589 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 24 08:41:15.671357 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-d4c34081-b100-446f-99b0-2674f741c589 admin admin] Request method failure captured: Oct 24 08:41:15.671357 dv-cinder-master-3-smb devstack@n-api.service[110139]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 24 08:41:15.671357 dv-cinder-master-3-smb devstack@n-api.service[110139]: Accept: application/json Oct 24 08:41:15.671357 dv-cinder-master-3-smb devstack@n-api.service[110139]: Accept-Encoding: gzip, deflate Oct 24 08:41:15.671357 dv-cinder-master-3-smb devstack@n-api.service[110139]: Connection: keep-alive Oct 24 08:41:15.671357 dv-cinder-master-3-smb devstack@n-api.service[110139]: Content-Length: 0 Oct 24 08:41:15.671357 dv-cinder-master-3-smb devstack@n-api.service[110139]: Host: 10.222.0.26 Oct 24 08:41:15.671357 dv-cinder-master-3-smb devstack@n-api.service[110139]: Openstack-Api-Version: compute 2.92 Oct 24 08:41:15.671357 dv-cinder-master-3-smb devstack@n-api.service[110139]: Openstack-System-Scope: None Oct 24 08:41:15.671357 dv-cinder-master-3-smb devstack@n-api.service[110139]: User-Agent: python-novaclient Oct 24 08:41:15.671357 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Auth-Token: gAAAAABjVk-qv37cbBYqGnHQ9-brirzNwDYwlAqpRwvD50JyZKNWk_gN2xp7ERicWm2R-6T1s4D4CbtUlNqvMR5zF9iEYlD4q-30T2Lda--G5aF3WIaIbrb5o8zNDpEu9GLXT68NwwmyaIaISQ1-W4HvqVugmR6BCvx3qCY_8MvxskqCnIC3Zi8 Oct 24 08:41:15.671357 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Domain-Id: None Oct 24 08:41:15.671357 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Domain-Name: None Oct 24 08:41:15.671357 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Identity-Status: Confirmed Oct 24 08:41:15.671357 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Is-Admin-Project: True Oct 24 08:41:15.671357 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Openstack-Nova-Api-Version: 2.92 Oct 24 08:41:15.671357 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Project-Domain-Id: default Oct 24 08:41:15.671357 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Project-Domain-Name: Default Oct 24 08:41:15.671357 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Project-Id: d2f48107e8bb4875908f0d6dc2693154 Oct 24 08:41:15.671357 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Project-Name: admin Oct 24 08:41:15.671357 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Role: admin,member,reader Oct 24 08:41:15.671357 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Roles: admin,member,reader Oct 24 08:41:15.672863 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d2f48107e8bb4875908f0d6dc2693154", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d2f48107e8bb4875908f0d6dc2693154"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d2f48107e8bb4875908f0d6dc2693154"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d2f48107e8bb4875908f0d6dc2693154"}]}] Oct 24 08:41:15.672863 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Tenant: admin Oct 24 08:41:15.672863 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Tenant-Id: d2f48107e8bb4875908f0d6dc2693154 Oct 24 08:41:15.672863 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-Tenant-Name: admin Oct 24 08:41:15.672863 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-User: admin Oct 24 08:41:15.672863 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-User-Domain-Id: default Oct 24 08:41:15.672863 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-User-Domain-Name: Default Oct 24 08:41:15.672863 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-User-Id: 2e8c1f674ea94c1eb2d8a47d1aad00af Oct 24 08:41:15.672863 dv-cinder-master-3-smb devstack@n-api.service[110139]: X-User-Name: admin Oct 24 08:41:15.672863 dv-cinder-master-3-smb devstack@n-api.service[110139]: method: > Oct 24 08:41:15.672863 dv-cinder-master-3-smb devstack@n-api.service[110139]: exception: Flavor 451 could not be found. Oct 24 08:41:15.672863 dv-cinder-master-3-smb devstack@n-api.service[110139]: action_args: {'id': '451'} Oct 24 08:41:15.672863 dv-cinder-master-3-smb devstack@n-api.service[110139]: {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:41:15.672863 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:41:15.673707 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 24 08:41:15.673707 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 24 08:41:15.673707 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 08:41:15.673707 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 08:41:15.673707 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 08:41:15.673707 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 08:41:15.673707 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 08:41:15.673707 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 08:41:15.673707 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 08:41:15.673707 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:41:15.673707 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 08:41:15.673707 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 08:41:15.673707 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 24 08:41:15.673707 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi Oct 24 08:41:15.673707 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:41:15.673707 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi Oct 24 08:41:15.673707 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:41:15.673707 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:41:15.673707 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:41:15.674767 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:41:15.674767 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:41:15.674767 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:41:15.674767 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:41:15.674767 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 24 08:41:15.674767 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:41:15.674767 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 24 08:41:15.674767 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi Oct 24 08:41:15.674767 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:41:15.674767 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi Oct 24 08:41:15.674767 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:41:15.674767 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:41:15.674767 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:41:15.674767 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:41:15.674767 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:41:15.674767 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 24 08:41:15.674767 dv-cinder-master-3-smb devstack@n-api.service[110139]: ERROR nova.api.openstack.wsgi Oct 24 08:41:15.674767 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-d4c34081-b100-446f-99b0-2674f741c589 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110139) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:41:15.675994 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.requestlog [None req-d4c34081-b100-446f-99b0-2674f741c589 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.428282 Oct 24 08:41:15.675994 dv-cinder-master-3-smb devstack@n-api.service[110139]: [pid: 110139|app: 0|req: 24/49] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Oct 24 08:41:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 430 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 24 08:41:15.686449 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-58a60853-e384-4a61-9e41-8ec28ffcb9a2 admin admin] Calling method '>' {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:41:15.706156 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-58a60853-e384-4a61-9e41-8ec28ffcb9a2 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025842 Oct 24 08:41:15.706682 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 26/50] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Oct 24 08:41:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:41:15.716300 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-ef5bbd3e-94bc-427b-ab18-b5cd5f5e89d9 admin admin] Calling method '>' {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:41:15.731150 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.requestlog [None req-ef5bbd3e-94bc-427b-ab18-b5cd5f5e89d9 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018352 Oct 24 08:41:15.731746 dv-cinder-master-3-smb devstack@n-api.service[110139]: [pid: 110139|app: 0|req: 25/51] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Oct 24 08:41:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:41:15.741038 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-6cb2ddb5-75f1-49bc-b3e5-4a9ced93d858 admin admin] Calling method '>' {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:41:15.746231 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.wsgi [None req-6cb2ddb5-75f1-49bc-b3e5-4a9ced93d858 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 24 08:41:15.747798 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-6cb2ddb5-75f1-49bc-b3e5-4a9ced93d858 admin admin] Request method failure captured: Oct 24 08:41:15.747798 dv-cinder-master-3-smb devstack@n-api.service[110138]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 24 08:41:15.747798 dv-cinder-master-3-smb devstack@n-api.service[110138]: Accept: application/json Oct 24 08:41:15.747798 dv-cinder-master-3-smb devstack@n-api.service[110138]: Accept-Encoding: gzip, deflate Oct 24 08:41:15.747798 dv-cinder-master-3-smb devstack@n-api.service[110138]: Connection: keep-alive Oct 24 08:41:15.747798 dv-cinder-master-3-smb devstack@n-api.service[110138]: Content-Length: 0 Oct 24 08:41:15.747798 dv-cinder-master-3-smb devstack@n-api.service[110138]: Host: 10.222.0.26 Oct 24 08:41:15.747798 dv-cinder-master-3-smb devstack@n-api.service[110138]: Openstack-Api-Version: compute 2.92 Oct 24 08:41:15.747798 dv-cinder-master-3-smb devstack@n-api.service[110138]: Openstack-System-Scope: None Oct 24 08:41:15.747798 dv-cinder-master-3-smb devstack@n-api.service[110138]: User-Agent: python-novaclient Oct 24 08:41:15.747798 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Auth-Token: gAAAAABjVk-qv37cbBYqGnHQ9-brirzNwDYwlAqpRwvD50JyZKNWk_gN2xp7ERicWm2R-6T1s4D4CbtUlNqvMR5zF9iEYlD4q-30T2Lda--G5aF3WIaIbrb5o8zNDpEu9GLXT68NwwmyaIaISQ1-W4HvqVugmR6BCvx3qCY_8MvxskqCnIC3Zi8 Oct 24 08:41:15.747798 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Domain-Id: None Oct 24 08:41:15.747798 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Domain-Name: None Oct 24 08:41:15.747798 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Identity-Status: Confirmed Oct 24 08:41:15.747798 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Is-Admin-Project: True Oct 24 08:41:15.747798 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Openstack-Nova-Api-Version: 2.92 Oct 24 08:41:15.747798 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Project-Domain-Id: default Oct 24 08:41:15.747798 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Project-Domain-Name: Default Oct 24 08:41:15.747798 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Project-Id: d2f48107e8bb4875908f0d6dc2693154 Oct 24 08:41:15.747798 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Project-Name: admin Oct 24 08:41:15.747798 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Role: admin,member,reader Oct 24 08:41:15.747798 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Roles: admin,member,reader Oct 24 08:41:15.749313 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d2f48107e8bb4875908f0d6dc2693154", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d2f48107e8bb4875908f0d6dc2693154"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d2f48107e8bb4875908f0d6dc2693154"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d2f48107e8bb4875908f0d6dc2693154"}]}] Oct 24 08:41:15.749313 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Tenant: admin Oct 24 08:41:15.749313 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Tenant-Id: d2f48107e8bb4875908f0d6dc2693154 Oct 24 08:41:15.749313 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-Tenant-Name: admin Oct 24 08:41:15.749313 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-User: admin Oct 24 08:41:15.749313 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-User-Domain-Id: default Oct 24 08:41:15.749313 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-User-Domain-Name: Default Oct 24 08:41:15.749313 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-User-Id: 2e8c1f674ea94c1eb2d8a47d1aad00af Oct 24 08:41:15.749313 dv-cinder-master-3-smb devstack@n-api.service[110138]: X-User-Name: admin Oct 24 08:41:15.749313 dv-cinder-master-3-smb devstack@n-api.service[110138]: method: > Oct 24 08:41:15.749313 dv-cinder-master-3-smb devstack@n-api.service[110138]: exception: Flavor 451 could not be found. Oct 24 08:41:15.749313 dv-cinder-master-3-smb devstack@n-api.service[110138]: action_args: {'id': '451'} Oct 24 08:41:15.749313 dv-cinder-master-3-smb devstack@n-api.service[110138]: {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:41:15.749313 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:41:15.750390 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 24 08:41:15.750390 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 24 08:41:15.750390 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 08:41:15.750390 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 08:41:15.750390 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 08:41:15.750390 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 08:41:15.750390 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 08:41:15.750390 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 08:41:15.750390 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 08:41:15.750390 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:41:15.750390 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 08:41:15.750390 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 08:41:15.750390 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 24 08:41:15.750390 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi Oct 24 08:41:15.750390 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:41:15.750390 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi Oct 24 08:41:15.750390 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:41:15.750390 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:41:15.750390 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:41:15.751680 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:41:15.751680 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:41:15.751680 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:41:15.751680 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:41:15.751680 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 24 08:41:15.751680 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:41:15.751680 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 24 08:41:15.751680 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi Oct 24 08:41:15.751680 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:41:15.751680 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi Oct 24 08:41:15.751680 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:41:15.751680 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:41:15.751680 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:41:15.751680 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:41:15.751680 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:41:15.751680 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 24 08:41:15.751680 dv-cinder-master-3-smb devstack@n-api.service[110138]: ERROR nova.api.openstack.wsgi Oct 24 08:41:15.751680 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-6cb2ddb5-75f1-49bc-b3e5-4a9ced93d858 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:41:15.752894 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-6cb2ddb5-75f1-49bc-b3e5-4a9ced93d858 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011599 Oct 24 08:41:15.752894 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 27/52] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Oct 24 08:41:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 24 08:41:16.970437 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-ef5bbd3e-94bc-427b-ab18-b5cd5f5e89d9 admin admin] Calling method '>' {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:41:16.971492 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.requestlog [None req-ef5bbd3e-94bc-427b-ab18-b5cd5f5e89d9 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Oct 24 08:41:16.971921 dv-cinder-master-3-smb devstack@n-api.service[110139]: [pid: 110139|app: 0|req: 26/53] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Oct 24 08:41:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:41:17.531300 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-648f1103-6d7a-4b90-bfa6-35a22e27119d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:41:17.553015 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-648f1103-6d7a-4b90-bfa6-35a22e27119d admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.445869 Oct 24 08:41:17.553554 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 28/54] 10.222.0.26 () {64 vars in 1235 bytes} [Mon Oct 24 08:41:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:41:18.772089 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-ef5bbd3e-94bc-427b-ab18-b5cd5f5e89d9 admin admin] Calling method '>' {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:41:18.772855 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.requestlog [None req-ef5bbd3e-94bc-427b-ab18-b5cd5f5e89d9 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Oct 24 08:41:18.773258 dv-cinder-master-3-smb devstack@n-api.service[110139]: [pid: 110139|app: 0|req: 27/55] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Oct 24 08:41:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:41:19.309000 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-02f0686e-4e88-449e-b4f2-ed1b406473d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:41:19.328883 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-02f0686e-4e88-449e-b4f2-ed1b406473d4 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.418747 Oct 24 08:41:19.329436 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 29/56] 10.222.0.26 () {64 vars in 1235 bytes} [Mon Oct 24 08:41:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:41:20.573945 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-ef5bbd3e-94bc-427b-ab18-b5cd5f5e89d9 admin admin] Calling method '>' {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:41:20.574998 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.requestlog [None req-ef5bbd3e-94bc-427b-ab18-b5cd5f5e89d9 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Oct 24 08:41:20.575395 dv-cinder-master-3-smb devstack@n-api.service[110139]: [pid: 110139|app: 0|req: 28/57] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Oct 24 08:41:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:41:21.131044 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-c68899f8-fa0f-4aa9-98e4-4a89d1dadd5e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:41:21.152326 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-c68899f8-fa0f-4aa9-98e4-4a89d1dadd5e admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.440870 Oct 24 08:41:21.152863 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 30/58] 10.222.0.26 () {64 vars in 1235 bytes} [Mon Oct 24 08:41:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:41:22.370751 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-ef5bbd3e-94bc-427b-ab18-b5cd5f5e89d9 admin admin] Calling method '>' {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:41:22.371765 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.requestlog [None req-ef5bbd3e-94bc-427b-ab18-b5cd5f5e89d9 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Oct 24 08:41:22.372318 dv-cinder-master-3-smb devstack@n-api.service[110139]: [pid: 110139|app: 0|req: 29/59] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Oct 24 08:41:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:41:22.927318 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-f4689d06-5397-4b09-912a-d1eb51ad7542 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:41:22.946437 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-f4689d06-5397-4b09-912a-d1eb51ad7542 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.438074 Oct 24 08:41:22.947014 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 31/60] 10.222.0.26 () {64 vars in 1235 bytes} [Mon Oct 24 08:41:22 2022] POST /compute/v2.1/flavors => generated 409 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:41:24.159251 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-ef5bbd3e-94bc-427b-ab18-b5cd5f5e89d9 admin admin] Calling method '>' {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:41:24.160263 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.requestlog [None req-ef5bbd3e-94bc-427b-ab18-b5cd5f5e89d9 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Oct 24 08:41:24.160677 dv-cinder-master-3-smb devstack@n-api.service[110139]: [pid: 110139|app: 0|req: 30/61] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Oct 24 08:41:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:41:24.706616 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-318c6c92-6c8d-4eae-81d6-cea9a3ac8e0a admin admin] Calling method '>' {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:41:24.727731 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-318c6c92-6c8d-4eae-81d6-cea9a3ac8e0a admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.431091 Oct 24 08:41:24.728183 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 32/62] 10.222.0.26 () {60 vars in 1202 bytes} [Mon Oct 24 08:41:24 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:42:21.162186 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-ef5bbd3e-94bc-427b-ab18-b5cd5f5e89d9 admin admin] Calling method '>' {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:42:21.163227 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.requestlog [None req-ef5bbd3e-94bc-427b-ab18-b5cd5f5e89d9 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Oct 24 08:42:21.163622 dv-cinder-master-3-smb devstack@n-api.service[110139]: [pid: 110139|app: 0|req: 31/63] 10.222.0.26 () {54 vars in 931 bytes} [Mon Oct 24 08:42:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:42:21.178431 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG dbcounter [-] [110138] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=110138) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:21.571459 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-1cb33508-7bfe-4d55-9d20-cf11037d0202 admin admin] Calling method '>' {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:42:21.592186 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-1cb33508-7bfe-4d55-9d20-cf11037d0202 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.421486 Oct 24 08:42:21.592736 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 33/64] 10.222.0.26 () {60 vars in 1292 bytes} [Mon Oct 24 08:42:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:42:21.614739 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG dbcounter [-] [110139] Writing DB stats nova_api:SELECT=14 {{(pid=110139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:21.618764 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-5333f08b-9059-4d57-92e8-2aa370fab4ca admin admin] Calling method '>' {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:42:21.626291 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.requestlog [None req-5333f08b-9059-4d57-92e8-2aa370fab4ca admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012958 Oct 24 08:42:21.626821 dv-cinder-master-3-smb devstack@n-api.service[110139]: [pid: 110139|app: 0|req: 32/65] 10.222.0.26 () {60 vars in 1283 bytes} [Mon Oct 24 08:42:21 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:42:21.638622 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-63baaa7a-50f8-4dd8-98f2-27b3da5f6b67 admin admin] Calling method '>' {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:42:21.645872 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-63baaa7a-50f8-4dd8-98f2-27b3da5f6b67 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010830 Oct 24 08:42:21.646374 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 34/66] 10.222.0.26 () {60 vars in 1286 bytes} [Mon Oct 24 08:42:21 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:42:21.657988 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-96a939e5-2206-4893-b6ea-94e0e051de82 admin admin] Calling method '>' {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:42:21.665594 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.requestlog [None req-96a939e5-2206-4893-b6ea-94e0e051de82 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011233 Oct 24 08:42:21.666113 dv-cinder-master-3-smb devstack@n-api.service[110139]: [pid: 110139|app: 0|req: 33/67] 10.222.0.26 () {60 vars in 1286 bytes} [Mon Oct 24 08:42:21 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:42:21.678569 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-19316829-a344-4d23-a11a-d566c99f568a admin admin] Calling method '>' {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:42:21.685684 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-19316829-a344-4d23-a11a-d566c99f568a admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010638 Oct 24 08:42:21.686171 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 35/68] 10.222.0.26 () {60 vars in 1283 bytes} [Mon Oct 24 08:42:21 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:45:29.606185 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-96a939e5-2206-4893-b6ea-94e0e051de82 admin admin] Calling method '>' {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:45:29.607235 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.requestlog [None req-96a939e5-2206-4893-b6ea-94e0e051de82 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Oct 24 08:45:29.607635 dv-cinder-master-3-smb devstack@n-api.service[110139]: [pid: 110139|app: 0|req: 34/69] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Oct 24 08:45:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:45:29.747912 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG dbcounter [-] [110138] Writing DB stats nova_api:SELECT=6 {{(pid=110138) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:45:29.917957 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-7b704ffe-22c6-4612-ac6d-ecf14964c6be admin admin] Calling method '>' {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:45:29.924171 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG oslo_concurrency.lockutils [None req-7b704ffe-22c6-4612-ac6d-ecf14964c6be admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:45:29.924647 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG oslo_concurrency.lockutils [None req-7b704ffe-22c6-4612-ac6d-ecf14964c6be admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:45:29.925067 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG oslo_concurrency.lockutils [None req-7b704ffe-22c6-4612-ac6d-ecf14964c6be admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:45:29.925769 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG oslo_concurrency.lockutils [None req-7b704ffe-22c6-4612-ac6d-ecf14964c6be admin admin] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:45:29.926221 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG oslo_concurrency.lockutils [None req-7b704ffe-22c6-4612-ac6d-ecf14964c6be admin admin] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:45:29.926630 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG oslo_concurrency.lockutils [None req-7b704ffe-22c6-4612-ac6d-ecf14964c6be admin admin] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:45:29.957524 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-7b704ffe-22c6-4612-ac6d-ecf14964c6be admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.92 time: 0.211749 Oct 24 08:45:29.958072 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 36/70] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Oct 24 08:45:29 2022] GET /compute/v2.1/os-services => generated 785 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:45:31.038805 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-96a939e5-2206-4893-b6ea-94e0e051de82 admin admin] Calling method '>' {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:45:31.040168 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.requestlog [None req-96a939e5-2206-4893-b6ea-94e0e051de82 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Oct 24 08:45:31.040573 dv-cinder-master-3-smb devstack@n-api.service[110139]: [pid: 110139|app: 0|req: 35/71] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Oct 24 08:45:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:45:31.270698 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-0e1254b2-d863-4431-bdad-81ed6b8b8d72 admin admin] Calling method '>' {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:45:31.274323 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG oslo_concurrency.lockutils [None req-0e1254b2-d863-4431-bdad-81ed6b8b8d72 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:45:31.274811 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG oslo_concurrency.lockutils [None req-0e1254b2-d863-4431-bdad-81ed6b8b8d72 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:45:31.275230 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG oslo_concurrency.lockutils [None req-0e1254b2-d863-4431-bdad-81ed6b8b8d72 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:45:31.275958 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG oslo_concurrency.lockutils [None req-0e1254b2-d863-4431-bdad-81ed6b8b8d72 admin admin] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:45:31.276388 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG oslo_concurrency.lockutils [None req-0e1254b2-d863-4431-bdad-81ed6b8b8d72 admin admin] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:45:31.276792 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG oslo_concurrency.lockutils [None req-0e1254b2-d863-4431-bdad-81ed6b8b8d72 admin admin] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:45:31.296891 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-0e1254b2-d863-4431-bdad-81ed6b8b8d72 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.92 time: 0.086536 Oct 24 08:45:31.297493 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 37/72] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Oct 24 08:45:31 2022] GET /compute/v2.1/os-services => generated 785 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:45:42.782475 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-96a939e5-2206-4893-b6ea-94e0e051de82 admin admin] Calling method '>' {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:45:42.783519 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.requestlog [None req-96a939e5-2206-4893-b6ea-94e0e051de82 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Oct 24 08:45:42.783917 dv-cinder-master-3-smb devstack@n-api.service[110139]: [pid: 110139|app: 0|req: 36/73] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Oct 24 08:45:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:45:42.929550 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG dbcounter [-] [110138] Writing DB stats nova_cell0:SELECT=4 {{(pid=110138) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:45:42.930426 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG dbcounter [-] [110138] Writing DB stats nova_cell1:SELECT=4 {{(pid=110138) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:45:42.931348 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG dbcounter [-] [110138] Writing DB stats nova_api:SELECT=8 {{(pid=110138) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:45:42.991559 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-07af2520-87b6-4e52-a35a-e3ab2f2e4b6b admin admin] Calling method '>' {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:45:42.995024 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG oslo_concurrency.lockutils [None req-07af2520-87b6-4e52-a35a-e3ab2f2e4b6b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:45:42.995501 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG oslo_concurrency.lockutils [None req-07af2520-87b6-4e52-a35a-e3ab2f2e4b6b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:45:42.995930 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG oslo_concurrency.lockutils [None req-07af2520-87b6-4e52-a35a-e3ab2f2e4b6b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:45:42.996641 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG oslo_concurrency.lockutils [None req-07af2520-87b6-4e52-a35a-e3ab2f2e4b6b admin admin] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:45:42.997083 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG oslo_concurrency.lockutils [None req-07af2520-87b6-4e52-a35a-e3ab2f2e4b6b admin admin] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:45:42.997494 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG oslo_concurrency.lockutils [None req-07af2520-87b6-4e52-a35a-e3ab2f2e4b6b admin admin] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:45:43.022542 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-07af2520-87b6-4e52-a35a-e3ab2f2e4b6b admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1005 microversion: 2.92 time: 0.101031 Oct 24 08:45:43.023130 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 38/74] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Oct 24 08:45:42 2022] GET /compute/v2.1/os-services => generated 1005 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:45:44.118672 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG nova.api.openstack.wsgi [None req-96a939e5-2206-4893-b6ea-94e0e051de82 admin admin] Calling method '>' {{(pid=110139) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:45:44.119708 dv-cinder-master-3-smb devstack@n-api.service[110139]: INFO nova.api.openstack.requestlog [None req-96a939e5-2206-4893-b6ea-94e0e051de82 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Oct 24 08:45:44.120107 dv-cinder-master-3-smb devstack@n-api.service[110139]: [pid: 110139|app: 0|req: 37/75] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Oct 24 08:45:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:45:44.321205 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG nova.api.openstack.wsgi [None req-8dd12947-6ec6-4e53-bcee-11e9e59e72a8 admin admin] Calling method '>' {{(pid=110138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:45:44.324579 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG oslo_concurrency.lockutils [None req-8dd12947-6ec6-4e53-bcee-11e9e59e72a8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:45:44.325008 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG oslo_concurrency.lockutils [None req-8dd12947-6ec6-4e53-bcee-11e9e59e72a8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:45:44.325448 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG oslo_concurrency.lockutils [None req-8dd12947-6ec6-4e53-bcee-11e9e59e72a8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:45:44.326141 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG oslo_concurrency.lockutils [None req-8dd12947-6ec6-4e53-bcee-11e9e59e72a8 admin admin] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:45:44.326571 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG oslo_concurrency.lockutils [None req-8dd12947-6ec6-4e53-bcee-11e9e59e72a8 admin admin] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:45:44.327004 dv-cinder-master-3-smb devstack@n-api.service[110138]: DEBUG oslo_concurrency.lockutils [None req-8dd12947-6ec6-4e53-bcee-11e9e59e72a8 admin admin] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:45:44.348206 dv-cinder-master-3-smb devstack@n-api.service[110138]: INFO nova.api.openstack.requestlog [None req-8dd12947-6ec6-4e53-bcee-11e9e59e72a8 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1005 microversion: 2.92 time: 0.091481 Oct 24 08:45:44.348745 dv-cinder-master-3-smb devstack@n-api.service[110138]: [pid: 110138|app: 0|req: 39/76] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Oct 24 08:45:44 2022] GET /compute/v2.1/os-services => generated 1005 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:46:52.060900 dv-cinder-master-3-smb devstack@n-api.service[110137]: Mon Oct 24 08:46:52 2022 - graceful shutdown triggered... Oct 24 08:46:52.060579 dv-cinder-master-3-smb systemd[1]: Stopping Devstack devstack@n-api.service... Oct 24 08:46:52.061912 dv-cinder-master-3-smb devstack@n-api.service[110139]: Gracefully killing worker 2 (pid: 110139)... Oct 24 08:46:52.062342 dv-cinder-master-3-smb devstack@n-api.service[110138]: Gracefully killing worker 1 (pid: 110138)... Oct 24 08:46:52.192846 dv-cinder-master-3-smb devstack@n-api.service[110139]: DEBUG dbcounter [-] [110139] Writing DB stats nova_api:SELECT=4 {{(pid=110139) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:46:53.061729 dv-cinder-master-3-smb devstack@n-api.service[110137]: worker 1 buried after 1 seconds Oct 24 08:46:53.061729 dv-cinder-master-3-smb devstack@n-api.service[110137]: worker 2 buried after 1 seconds Oct 24 08:46:53.061729 dv-cinder-master-3-smb devstack@n-api.service[110137]: goodbye to uWSGI. Oct 24 08:46:53.064298 dv-cinder-master-3-smb systemd[1]: devstack@n-api.service: Succeeded. Oct 24 08:46:53.065210 dv-cinder-master-3-smb systemd[1]: Stopped Devstack devstack@n-api.service. Oct 24 08:46:53.069569 dv-cinder-master-3-smb systemd[1]: Starting Devstack devstack@n-api.service... Oct 24 08:46:53.084219 dv-cinder-master-3-smb devstack@n-api.service[125146]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 24 08:46:53.086449 dv-cinder-master-3-smb devstack@n-api.service[125146]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 24 08:46:53 2022] *** Oct 24 08:46:53.086449 dv-cinder-master-3-smb devstack@n-api.service[125146]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 24 08:46:53.086449 dv-cinder-master-3-smb devstack@n-api.service[125146]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 24 08:46:53.086449 dv-cinder-master-3-smb devstack@n-api.service[125146]: nodename: dv-cinder-master-3-smb Oct 24 08:46:53.086449 dv-cinder-master-3-smb devstack@n-api.service[125146]: machine: x86_64 Oct 24 08:46:53.086449 dv-cinder-master-3-smb devstack@n-api.service[125146]: clock source: unix Oct 24 08:46:53.086449 dv-cinder-master-3-smb devstack@n-api.service[125146]: pcre jit disabled Oct 24 08:46:53.086449 dv-cinder-master-3-smb devstack@n-api.service[125146]: detected number of CPU cores: 4 Oct 24 08:46:53.086449 dv-cinder-master-3-smb devstack@n-api.service[125146]: current working directory: / Oct 24 08:46:53.086449 dv-cinder-master-3-smb devstack@n-api.service[125146]: detected binary path: /usr/bin/uwsgi-core Oct 24 08:46:53.088249 dv-cinder-master-3-smb devstack@n-api.service[125146]: your processes number limit is 47680 Oct 24 08:46:53.088249 dv-cinder-master-3-smb devstack@n-api.service[125146]: your memory page size is 4096 bytes Oct 24 08:46:53.088249 dv-cinder-master-3-smb devstack@n-api.service[125146]: detected max file descriptor number: 2048 Oct 24 08:46:53.088249 dv-cinder-master-3-smb devstack@n-api.service[125146]: lock engine: pthread robust mutexes Oct 24 08:46:53.088249 dv-cinder-master-3-smb devstack@n-api.service[125146]: thunder lock: enabled Oct 24 08:46:53.088249 dv-cinder-master-3-smb devstack@n-api.service[125146]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 24 08:46:53.088249 dv-cinder-master-3-smb devstack@n-api.service[125146]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 24 08:46:53.130615 dv-cinder-master-3-smb devstack@n-api.service[125146]: Python main interpreter initialized at 0x557deb5ca9c0 Oct 24 08:46:53.130890 dv-cinder-master-3-smb devstack@n-api.service[125146]: python threads support enabled Oct 24 08:46:53.130890 dv-cinder-master-3-smb devstack@n-api.service[125146]: your server socket listen backlog is limited to 100 connections Oct 24 08:46:53.130890 dv-cinder-master-3-smb devstack@n-api.service[125146]: your mercy for graceful operations on workers is 90 seconds Oct 24 08:46:53.131123 dv-cinder-master-3-smb devstack@n-api.service[125146]: mapped 403077 bytes (393 KB) for 2 cores Oct 24 08:46:53.131123 dv-cinder-master-3-smb devstack@n-api.service[125146]: *** Operational MODE: preforking *** Oct 24 08:46:53.131464 dv-cinder-master-3-smb devstack@n-api.service[125146]: *** uWSGI is running in multiple interpreter mode *** Oct 24 08:46:53.131464 dv-cinder-master-3-smb devstack@n-api.service[125146]: spawned uWSGI master process (pid: 125146) Oct 24 08:46:53.131680 dv-cinder-master-3-smb systemd[1]: Started Devstack devstack@n-api.service. Oct 24 08:46:53.132665 dv-cinder-master-3-smb devstack@n-api.service[125146]: spawned uWSGI worker 1 (pid: 125164, cores: 1) Oct 24 08:46:53.133343 dv-cinder-master-3-smb devstack@n-api.service[125146]: spawned uWSGI worker 2 (pid: 125165, cores: 1) Oct 24 08:46:53.133802 dv-cinder-master-3-smb devstack@n-api.service[125146]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 24 08:46:53.785068 dv-cinder-master-3-smb devstack@n-api.service[125164]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 24 08:46:53.785695 dv-cinder-master-3-smb devstack@n-api.service[125165]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 24 08:46:54.995362 dv-cinder-master-3-smb devstack@n-api.service[125165]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 08:46:54.995362 dv-cinder-master-3-smb devstack@n-api.service[125165]: from cryptography.utils import int_from_bytes Oct 24 08:46:54.996223 dv-cinder-master-3-smb devstack@n-api.service[125165]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 08:46:54.996223 dv-cinder-master-3-smb devstack@n-api.service[125165]: from cryptography.utils import int_from_bytes Oct 24 08:46:55.002884 dv-cinder-master-3-smb devstack@n-api.service[125164]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 08:46:55.002884 dv-cinder-master-3-smb devstack@n-api.service[125164]: from cryptography.utils import int_from_bytes Oct 24 08:46:55.003403 dv-cinder-master-3-smb devstack@n-api.service[125164]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 08:46:55.003403 dv-cinder-master-3-smb devstack@n-api.service[125164]: from cryptography.utils import int_from_bytes Oct 24 08:46:57.372571 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 24 08:46:57.373160 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 24 08:46:57.373412 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 24 08:46:57.373697 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 24 08:46:57.373961 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 24 08:46:57.374370 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.374692 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.375049 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.375368 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.375696 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.375975 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.376319 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.376609 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.376964 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.377197 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.377600 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.377869 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.378176 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.378493 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.378859 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.379158 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.379462 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.379767 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.380085 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.380593 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.382153 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.382153 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.382153 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.382153 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.382468 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.382551 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.382854 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.383165 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.383490 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.383824 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.384196 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.384532 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.384823 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.385188 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.385532 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.385857 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.386147 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.386464 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.386847 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.387149 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.387455 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.387784 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.388112 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.388430 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.388727 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.389052 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.389332 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.389648 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.389946 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.390238 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.390496 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.390820 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.391138 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.391458 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.391779 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.392027 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.392271 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.392589 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.392907 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.393203 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.393521 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.393821 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.394284 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.394560 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.394915 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.395227 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.395531 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.395849 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.396163 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.396484 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.396791 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.397109 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.397491 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.397656 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 24 08:46:57.398174 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.398332 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 24 08:46:57.398485 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.398636 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 24 08:46:57.398819 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.398819 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.399198 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 24 08:46:57.399198 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 24 08:46:57.399468 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.399468 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.399753 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.399894 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.400049 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.400200 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.400373 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.400528 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.400682 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.400842 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.400990 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.401371 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.401526 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.401675 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.401826 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.401982 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.402131 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.402277 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.402423 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.402571 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.402755 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.402916 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.403075 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.403225 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.403379 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.403536 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.403768 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.403922 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.404069 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.404217 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.404385 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.404607 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.404763 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.404914 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.405151 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.405319 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.405467 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.405615 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.405765 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.406001 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.406001 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.406325 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.406484 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.406635 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.406936 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.407111 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.407344 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.407489 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.407636 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.407782 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.407933 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.407933 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.408214 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.408360 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.408516 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.408677 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.408817 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.408967 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.409114 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.409280 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.409429 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.409568 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.409717 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.409863 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.410016 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.410163 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.410303 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.410441 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.410586 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.410769 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.410917 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.411070 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.411247 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.411656 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.411804 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.411961 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.412104 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.412251 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.412401 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.412541 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.412699 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.412839 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.412978 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.413118 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.413274 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.413422 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.413422 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.413708 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.413948 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.414098 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.414258 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.414406 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.414985 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.415155 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.415387 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.415540 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.415689 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.415844 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.416010 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.416289 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.416446 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.416587 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.416726 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.416892 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.417145 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.417313 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.417528 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.417679 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.417819 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.417967 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.418117 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.418264 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.418405 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.418551 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.418701 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.418895 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.418895 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.419179 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.419320 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.419471 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.419626 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.419782 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.419922 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.420071 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.420303 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.420460 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.420611 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.420752 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.420900 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.421039 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.421186 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.421337 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.421509 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.421910 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.422070 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.422220 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.422369 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.422524 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.422678 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.422869 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.423010 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.423149 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.423299 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.423452 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.423600 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.423746 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.423925 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.424150 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.424295 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.424449 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.424601 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.424748 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.425723 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.425890 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.426033 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.426184 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.426466 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.426633 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.426827 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.426827 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.427159 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.427384 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.427550 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.427769 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.427922 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.428063 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.428215 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.428364 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.428511 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.428659 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.428659 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.428926 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.429094 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.429094 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.429375 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.429523 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.429677 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.429830 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.430056 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.430214 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.430364 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.430504 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.430655 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.430868 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.431024 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.431163 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.431303 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.431442 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.431588 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.431759 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.431759 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.432214 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.432367 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.432515 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.432655 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.432905 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.433060 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.433213 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.433366 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.433506 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.433653 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.433802 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.433943 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.434298 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.434444 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.434592 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.435420 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.435595 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.435810 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.435959 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.436112 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.436260 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.436526 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.436685 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.436827 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.436967 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.437115 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.437257 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.437427 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.437427 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.437949 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.438120 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.438281 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.438441 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.438559 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.438646 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.438777 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.438876 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.438974 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.439069 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.439069 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.439232 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.439317 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.439407 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.439499 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.439588 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.439674 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.439756 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.439845 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.439934 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.440034 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.440118 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.440211 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.440308 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.440401 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.440401 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.440564 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.440564 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.440724 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.440807 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.440899 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.440899 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.440899 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.440899 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.440899 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.440899 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.440899 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.441437 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.441522 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.441522 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.441522 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.441522 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.441828 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:46:57.442184 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.442290 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.442427 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.442518 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.442886 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.443160 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.443268 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.443993 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.444114 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.447058 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.447058 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.447385 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.447486 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.447579 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.447683 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.447776 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.448159 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.448270 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.448358 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.448436 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.448527 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.448619 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.448703 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.448703 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.448865 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.448947 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.449036 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.449119 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.449215 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.449305 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.449305 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.449456 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.449545 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.449545 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.449545 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.449790 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.449880 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.449880 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.450112 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.450516 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.450637 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.450862 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.450986 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.451193 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.451488 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.451700 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.451866 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.452146 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.452273 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.452511 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.452763 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.452885 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.453282 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.453430 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.453641 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.453811 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.454205 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.454327 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.454582 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.454832 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.455078 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.455290 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.455541 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.455759 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.456078 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.456209 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.456516 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.456699 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.457172 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.457295 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.457390 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.457569 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.457841 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.458080 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.458311 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.458452 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.458772 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.458915 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.459218 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.459353 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.459658 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.459798 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.460092 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.460245 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.460535 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.460710 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.460967 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.461157 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.461408 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.461599 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.461836 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.462042 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.462264 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.462481 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.462679 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.462988 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.463117 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.463909 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.464066 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.464163 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.464259 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.464259 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.464421 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.464737 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.464830 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.465157 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.465280 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.465611 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.465702 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.466444 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.466587 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.466681 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.466835 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.466924 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.467020 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.467402 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.467492 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.467687 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.467892 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.468172 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.468377 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.468639 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.468891 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.468984 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.469326 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.469414 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.469763 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.469865 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.470189 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.470293 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.470648 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.470790 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.471081 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.471173 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.471503 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.471602 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.471937 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.472036 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.472410 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.472521 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.472835 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.472977 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.473262 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.473427 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.473691 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.473886 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.474175 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.474334 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.474554 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.474802 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.475009 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.475248 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.475479 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.475693 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.475929 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.476136 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.476356 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.476581 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.476830 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.477036 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.477444 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.477560 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.477647 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.477918 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.478057 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.478364 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.478480 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.478836 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.478941 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.479275 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.479365 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.479694 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.479799 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.480119 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.480224 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.480541 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.480640 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.480972 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.481072 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.481390 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.481532 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.481814 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.481974 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.482237 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.482459 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.482681 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.482946 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.483134 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.483327 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.483570 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.483772 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.483996 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.484226 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.484424 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.484655 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.484889 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.485094 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.485313 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.485537 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.485787 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.485982 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.486242 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.486426 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.486695 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.486915 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.487160 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.487378 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.492716 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.492716 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.492716 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.492716 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.492716 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.492716 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.492716 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.492716 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.494410 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.494410 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.494410 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.494410 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.494410 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.494410 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.494410 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.494410 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.496399 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.496399 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.496399 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.496399 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.496399 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.496891 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.497817 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.497940 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.498031 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.498913 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.499472 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.499573 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.499666 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.499750 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.499848 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.500012 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.500105 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.500863 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.501008 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.501143 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.501240 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.501321 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.501482 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.501769 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.501861 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.502192 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.502377 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.502852 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.502976 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.503559 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.503736 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.503849 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.504177 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.504313 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.504671 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.505129 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.505461 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.505461 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.505877 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.506595 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.506865 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.507198 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.507303 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.507476 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.507592 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.507839 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.508061 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.508176 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.508477 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.508697 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.508809 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.509174 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.509282 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.509558 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.509673 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.509903 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.510018 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.510272 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.510376 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.510650 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.510842 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.511035 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.511164 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.511368 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.511502 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.511698 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.511872 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.512037 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.512184 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.512368 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.512521 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.512693 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.512833 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.513020 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.513150 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.513344 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.513462 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.513665 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.513767 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.513988 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.514092 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.514322 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.514421 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.514640 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.514764 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.514997 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.515103 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.515310 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.515411 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.515623 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.515716 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.515943 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.516033 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.516264 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.516354 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.516578 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.516867 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.516966 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.517211 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.517307 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.517517 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.517609 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.517846 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.517946 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.518146 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.518288 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.518455 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.518570 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.518788 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.518908 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.519149 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.519272 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.519476 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.519584 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.519787 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.519893 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.520118 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.520218 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.520416 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.520515 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.520722 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.520823 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.521032 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.521125 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.521351 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.521441 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.521662 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.521929 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.522029 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.522262 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.522361 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.522573 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.522663 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.522910 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.523004 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.523223 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.523317 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.523536 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.523642 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.523859 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.523960 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.524173 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.524274 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.524491 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.524589 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.524798 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.524901 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.525111 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.525225 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.525419 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.525531 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.525721 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.525813 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.526033 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.526126 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.526337 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.526424 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.526641 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.526753 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.526982 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.527109 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.527291 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.527466 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.527806 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.528158 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.528405 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.528497 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.528732 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.528826 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.529029 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.529118 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.529338 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.529420 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.529659 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.529739 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.529967 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.530093 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.530279 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.530359 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.530584 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.530663 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.530923 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.531020 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.531431 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.531750 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.532020 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.532326 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.532467 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.532673 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.532818 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.532982 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.533154 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.533325 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.533487 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.533657 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.533809 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.534006 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.534136 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.534317 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.534456 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.534624 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.534916 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.535150 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.535233 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.535492 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.535598 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.535762 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.535855 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.536195 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.536306 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.536392 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.536485 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.536686 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.536777 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.536989 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.537099 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.537301 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.537450 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.537610 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.537702 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.537918 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.538038 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.538230 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.538318 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.538516 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.538612 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.538847 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.538964 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.539148 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.539241 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.539773 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.539879 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.540085 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.540185 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.540386 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.540485 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.540686 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.540777 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.540999 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.541091 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.541307 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.541399 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.541609 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.541696 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.541919 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.542030 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.542217 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.542337 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.542531 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.542632 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.542853 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.543009 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.543147 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.543246 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.543450 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.543549 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.543758 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.543857 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.544071 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.544162 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.544370 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.544461 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.544681 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.544772 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.544988 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.545076 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.545290 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.545391 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.545596 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.545724 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.545900 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.546042 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.546202 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.546378 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.546523 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.546659 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.546818 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.546924 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.547141 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.547247 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.547458 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.547624 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.547763 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.547915 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.548134 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.548251 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.548375 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.548466 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.548680 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.548771 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.548984 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.549252 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.549353 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.549447 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.549575 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.549668 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.549878 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.549971 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.550177 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.550265 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.550585 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.550669 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.550930 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.551017 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.551254 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.551354 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.551561 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.551660 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.551865 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.551973 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.552172 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.552314 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.552470 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.552573 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.552797 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.552892 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.553103 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.553194 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.553419 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.553518 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.553746 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.553838 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.554062 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.554163 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.554381 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.554487 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.554687 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.554893 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.555034 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.555125 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.555346 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.555451 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.555721 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.555827 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.555964 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.556057 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.556269 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.556435 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.556581 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.556685 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.556883 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.557068 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.557184 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.557294 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.557513 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.557605 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.557807 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.557905 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.558113 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.558205 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.558426 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.558518 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.558763 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.558860 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.559076 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.559189 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.559375 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.559467 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.559688 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.559786 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.559995 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.560097 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.560299 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.560396 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.560604 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.560701 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.560911 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.561002 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.561215 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.561312 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.561521 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.561831 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.561930 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.562220 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.562328 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.562443 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.562545 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.562772 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.562887 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.563087 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.563179 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.563397 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.563488 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.563700 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.563793 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.564030 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.564127 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.564339 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.564438 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.564642 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.564820 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.564948 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.565141 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.565252 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.565464 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.565558 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.565784 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.565937 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.566123 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.566432 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.566560 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.566764 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.566868 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.567095 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.567202 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.567404 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.567506 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.567713 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.567812 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.568020 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.568119 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.568348 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.568460 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.568662 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.568819 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.568963 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.569118 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.569364 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.569514 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.569680 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.569819 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.569987 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.570137 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.570284 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.570428 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.570586 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.570771 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.570913 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.571053 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.571199 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.571336 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.571503 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.571657 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.571808 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.571972 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.572160 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.572376 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.572516 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.572663 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.572799 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.572954 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.573092 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.573272 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.573429 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.573569 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.573715 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.573861 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.574009 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.574163 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.574315 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.574444 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.574686 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.574840 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.575019 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.575137 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.575324 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.575427 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.575646 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.575738 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.575966 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.576082 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.576291 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.576393 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.576596 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.576697 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.576908 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.577014 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.577215 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.577322 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.577535 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.577630 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.577860 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.577967 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.578171 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.578271 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.578484 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.578576 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.578810 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.578928 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.579134 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.579243 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.579454 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.579558 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.579765 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.579857 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.580081 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.580174 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.580393 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.580485 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.580699 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.580800 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.581007 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.581109 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.581332 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.581433 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.581690 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.581801 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.582018 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.582133 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.582340 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.582445 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.582657 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.582819 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.582998 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.583131 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.583305 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.583414 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.583629 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.583734 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.583932 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.584034 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.584238 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.584329 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.584544 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.584644 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.584849 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.584940 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.585148 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.585239 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.585450 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.585545 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.585754 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.585853 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.586060 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.586153 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.586379 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.586488 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.586692 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.586811 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.587034 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.587127 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.587355 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.587449 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.587656 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.587751 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.587976 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.588071 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.588284 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.588387 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.588585 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.588686 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.588895 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.589073 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.589219 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.589360 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.589524 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.589662 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.589829 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.589988 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.590137 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.590275 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.590424 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.590708 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.590846 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.590953 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.591048 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.591145 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.591329 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.591459 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.591637 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.591786 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.591964 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.592103 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.592271 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.592412 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.592599 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.592723 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.592912 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.593037 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.593226 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.593395 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.593547 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.593658 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.593829 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.593968 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.594162 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.594304 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.594456 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.594600 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.594814 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.594921 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.595119 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.595218 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.595420 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.595513 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.595724 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.595816 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.596024 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.596124 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.596345 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.596437 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.596650 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.596762 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.596970 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.597070 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.597338 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.597442 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.597651 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.597742 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.597959 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.598073 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.598262 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.598356 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.598581 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.598671 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.598959 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.599064 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.599273 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.599586 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.599752 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.599904 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.600065 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.600206 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.600363 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.600535 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.600685 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.600836 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.600987 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.601124 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.601260 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.601417 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.601558 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.601731 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.601880 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.602047 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.602203 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.602357 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.602504 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.602662 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.602804 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.602979 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.603081 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.603318 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.603421 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.603641 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.603848 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.603962 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.604179 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.604315 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.604495 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.604601 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.604809 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.604902 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.605122 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.605220 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.605436 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.605556 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.605751 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.605874 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.606063 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.606185 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.606376 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.606503 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.606689 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.606847 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.607023 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.607165 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.607354 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.607462 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.607679 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.607779 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.608005 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.608107 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.608343 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.608438 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.608663 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.608753 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.608980 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.609100 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.609295 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.609394 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.609607 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.609705 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.609934 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.610044 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.610266 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.610358 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.610570 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.610662 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.610908 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.611004 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.611224 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.611317 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.611539 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.611632 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.611850 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.612059 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.612151 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.612379 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.612481 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.612717 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.612837 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.613073 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.613163 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.613416 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.613510 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.614280 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.614384 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.614470 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.614551 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.614625 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.614704 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.614905 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.614991 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.614991 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.615132 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.615303 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.615397 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.615616 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.615715 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.615924 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.616024 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.616250 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.616439 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.616571 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.616751 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.616852 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.617082 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.617181 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.617409 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.617507 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.617731 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.617997 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.618090 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.618349 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.618453 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.618668 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.618791 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.618998 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.619095 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.619301 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.619405 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.619613 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.619714 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.619924 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.620017 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.620227 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.620354 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.620546 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.620638 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.620851 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.620949 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.621153 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.621244 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.621468 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.621558 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.621773 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.621873 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.622081 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.622299 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.622391 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.622648 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.622750 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.622991 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.623075 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.623315 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.623420 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.623618 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.623711 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.623940 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.624032 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.624248 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.624383 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.624555 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.624662 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.624861 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.624963 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.625201 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.625319 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.625471 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.625583 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.625776 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.625876 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.626074 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.626174 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.626379 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.626529 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.626684 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.626823 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.627012 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.627113 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.627308 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.627409 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.627615 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.627739 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.627917 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.628010 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.628243 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.628357 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.628621 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.628715 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.628924 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.629016 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.629228 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.629343 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.629539 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.629651 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.629839 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.629946 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.630141 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.630259 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.630442 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.630543 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.630759 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.630870 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.631072 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.631173 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.631373 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.631473 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.631681 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.631773 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.631983 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.632085 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.632338 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.632568 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.632670 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.632907 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.633008 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.633227 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.633338 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.633547 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.633641 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.633849 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.633956 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.634149 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.634241 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.634461 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.634558 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.634787 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.634880 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.635107 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.635204 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.635421 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.635532 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.635730 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.635824 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.636039 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.636137 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.636372 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.636474 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.636667 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.636893 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.636992 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.637227 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.637328 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.637554 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.637647 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.637877 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.637967 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.638189 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.638338 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.638505 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.638602 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.638826 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.638924 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.639197 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.639299 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.639452 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.639572 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.639763 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.639856 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.640074 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.640192 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.640387 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.640490 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.640693 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.640795 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.641000 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.641101 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.641309 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.641405 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.641615 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.641697 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.641923 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.642034 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.642227 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.642336 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.642538 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.642636 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.642862 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.642972 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.643169 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.643275 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.643475 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.643578 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.643778 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.643873 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.644113 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.644247 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.644452 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.644555 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.644773 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.644873 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.645087 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.645190 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.645414 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.645507 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.645720 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.645832 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.646026 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.646119 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.646335 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.646437 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.646641 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.646774 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.646973 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.647067 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.647288 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.647395 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.647618 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.647712 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.647932 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.648047 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.648241 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.648372 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.648631 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.648722 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.648940 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.649034 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.649247 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.649340 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.649559 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.649658 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.649866 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.649966 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.650183 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.650283 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.650494 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.650606 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.651271 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.651384 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.651487 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.651575 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.651667 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.651760 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.651846 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.651938 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.652031 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.652123 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.652337 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.652430 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.652649 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.652757 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.652955 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.653048 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.653261 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.653355 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.653569 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.653683 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.653872 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.653971 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.654176 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.654268 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.654482 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.654589 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.654801 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.654895 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.655107 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.655200 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.655415 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.655506 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.655790 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.655905 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.656020 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.656114 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.656324 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.656427 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.656638 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.656728 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.656935 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.657049 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.657233 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.657341 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.657535 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.657627 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.657838 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.657931 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.658140 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.658250 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.658441 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.658535 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.658760 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.658876 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.659072 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.659166 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.659376 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.659468 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.659743 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.659849 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.660053 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.660146 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.660357 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.660450 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.660660 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.660777 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.660993 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.661086 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.661330 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.661422 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.661641 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.661746 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.661954 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.662054 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.662270 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.662360 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.662591 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.662685 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.662920 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.663025 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.663244 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.663344 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.663564 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.663676 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.663876 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.663968 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.664184 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.664275 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.664808 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.664942 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.665122 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.665228 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.665436 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.665613 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.665747 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.665933 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.666081 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.666220 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.666369 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.666521 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.666670 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.666788 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.666977 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.667084 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.667292 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.667393 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.667593 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.667684 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.667914 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.668014 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.668229 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.668337 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.668550 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.668648 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.668861 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.668950 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.669169 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.669260 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.669496 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.669587 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.669803 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.669893 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.670110 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.670211 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.670416 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.670511 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.670742 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.670880 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.671055 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.671152 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.671367 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.671477 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.671677 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.671786 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.671990 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.672090 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.672276 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 24 08:46:57.672368 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.672606 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.672931 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.673254 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.673562 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.673885 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.674211 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.674557 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.674890 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.675234 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.675587 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.675900 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.676205 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.676506 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:46:57.676745 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 24 08:46:57.734597 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO dbcounter [None req-bf0553b6-413b-47d0-a07f-8d10d434b7ed None None] Registered counter for database nova_api Oct 24 08:46:57.737764 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO dbcounter [None req-eac9840d-e7e7-444b-ab12-5940149fb516 None None] Registered counter for database nova_api Oct 24 08:46:57.755873 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_db.sqlalchemy.engines [None req-bf0553b6-413b-47d0-a07f-8d10d434b7ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125165) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 08:46:57.757355 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_db.sqlalchemy.engines [None req-eac9840d-e7e7-444b-ab12-5940149fb516 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125164) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 08:46:57.763511 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writer thread running {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 08:46:57.763955 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writer thread running {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 08:46:57.819070 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.context [None req-eac9840d-e7e7-444b-ab12-5940149fb516 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dfb1c4c1-9694-4501-9182-d459e78ba11f(cell1) {{(pid=125164) load_cells /opt/stack/nova/nova/context.py:464}} Oct 24 08:46:57.819278 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.context [None req-bf0553b6-413b-47d0-a07f-8d10d434b7ed None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dfb1c4c1-9694-4501-9182-d459e78ba11f(cell1) {{(pid=125165) load_cells /opt/stack/nova/nova/context.py:464}} Oct 24 08:46:57.823059 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-eac9840d-e7e7-444b-ab12-5940149fb516 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:46:57.823229 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bf0553b6-413b-47d0-a07f-8d10d434b7ed None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:46:57.823527 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-eac9840d-e7e7-444b-ab12-5940149fb516 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:46:57.823669 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bf0553b6-413b-47d0-a07f-8d10d434b7ed None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:46:57.825114 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-eac9840d-e7e7-444b-ab12-5940149fb516 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:46:57.825271 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bf0553b6-413b-47d0-a07f-8d10d434b7ed None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:46:57.825824 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-eac9840d-e7e7-444b-ab12-5940149fb516 None None] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:46:57.825966 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bf0553b6-413b-47d0-a07f-8d10d434b7ed None None] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:46:57.826264 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-eac9840d-e7e7-444b-ab12-5940149fb516 None None] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:46:57.826406 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bf0553b6-413b-47d0-a07f-8d10d434b7ed None None] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:46:57.828278 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-eac9840d-e7e7-444b-ab12-5940149fb516 None None] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:46:57.828443 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bf0553b6-413b-47d0-a07f-8d10d434b7ed None None] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:46:57.830280 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO dbcounter [None req-eac9840d-e7e7-444b-ab12-5940149fb516 None None] Registered counter for database nova_cell0 Oct 24 08:46:57.830432 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO dbcounter [None req-bf0553b6-413b-47d0-a07f-8d10d434b7ed None None] Registered counter for database nova_cell0 Oct 24 08:46:57.834496 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO dbcounter [None req-bf0553b6-413b-47d0-a07f-8d10d434b7ed None None] Registered counter for database nova_cell1 Oct 24 08:46:57.834659 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO dbcounter [None req-eac9840d-e7e7-444b-ab12-5940149fb516 None None] Registered counter for database nova_cell1 Oct 24 08:46:57.843113 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_db.sqlalchemy.engines [None req-eac9840d-e7e7-444b-ab12-5940149fb516 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125164) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 08:46:57.844707 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_db.sqlalchemy.engines [None req-bf0553b6-413b-47d0-a07f-8d10d434b7ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125165) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 08:46:57.848567 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_db.sqlalchemy.engines [None req-eac9840d-e7e7-444b-ab12-5940149fb516 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125164) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 08:46:57.849600 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writer thread running {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 08:46:57.850243 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_db.sqlalchemy.engines [None req-bf0553b6-413b-47d0-a07f-8d10d434b7ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125165) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 08:46:57.853795 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writer thread running {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 08:46:57.855896 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writer thread running {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 08:46:57.989053 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writer thread running {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 08:46:57.998413 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO dbcounter [None req-bf0553b6-413b-47d0-a07f-8d10d434b7ed None None] Registered counter for database nova_cell0 Oct 24 08:46:58.004427 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO dbcounter [None req-eac9840d-e7e7-444b-ab12-5940149fb516 None None] Registered counter for database nova_cell0 Oct 24 08:46:58.005314 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_db.sqlalchemy.engines [None req-bf0553b6-413b-47d0-a07f-8d10d434b7ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125165) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 08:46:58.010118 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writer thread running {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 08:46:58.012988 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_db.sqlalchemy.engines [None req-eac9840d-e7e7-444b-ab12-5940149fb516 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125164) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 08:46:58.019393 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writer thread running {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 08:46:58.325696 dv-cinder-master-3-smb devstack@n-api.service[125165]: WARNING keystonemiddleware.auth_token [None req-bf0553b6-413b-47d0-a07f-8d10d434b7ed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 08:46:58.333171 dv-cinder-master-3-smb devstack@n-api.service[125165]: WARNING keystonemiddleware.auth_token [None req-bf0553b6-413b-47d0-a07f-8d10d434b7ed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 08:46:58.342368 dv-cinder-master-3-smb devstack@n-api.service[125164]: WARNING keystonemiddleware.auth_token [None req-eac9840d-e7e7-444b-ab12-5940149fb516 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 08:46:58.349958 dv-cinder-master-3-smb devstack@n-api.service[125164]: WARNING keystonemiddleware.auth_token [None req-eac9840d-e7e7-444b-ab12-5940149fb516 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 08:46:58.681025 dv-cinder-master-3-smb devstack@n-api.service[125165]: WARNING keystonemiddleware.auth_token [None req-bf0553b6-413b-47d0-a07f-8d10d434b7ed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 08:46:58.687448 dv-cinder-master-3-smb devstack@n-api.service[125165]: WARNING keystonemiddleware.auth_token [None req-bf0553b6-413b-47d0-a07f-8d10d434b7ed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 08:46:58.693014 dv-cinder-master-3-smb devstack@n-api.service[125165]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557deb5ca9c0 pid: 125165 (default app) Oct 24 08:46:58.697950 dv-cinder-master-3-smb devstack@n-api.service[125164]: WARNING keystonemiddleware.auth_token [None req-eac9840d-e7e7-444b-ab12-5940149fb516 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 08:46:58.703948 dv-cinder-master-3-smb devstack@n-api.service[125164]: WARNING keystonemiddleware.auth_token [None req-eac9840d-e7e7-444b-ab12-5940149fb516 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 08:46:58.709265 dv-cinder-master-3-smb devstack@n-api.service[125164]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557deb5ca9c0 pid: 125164 (default app) Oct 24 08:47:33.976537 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_api:SELECT=3 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:47:33.977404 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell0:SELECT=3 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:47:33.978410 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell1:SELECT=3 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:47:33.979205 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell0:SELECT=3 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:47:35.675346 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-61f2cd4a-131d-4715-970c-1a9977d78a41 tempest-VolumesGetTestJSON-1429214493 tempest-VolumesGetTestJSON-1429214493-project] Action: 'create', calling method: .version_select at 0x7f7ef260dee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-879654818", "metadata": {"Type": "work"}}} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:47:37.477398 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-61f2cd4a-131d-4715-970c-1a9977d78a41 tempest-VolumesGetTestJSON-1429214493 tempest-VolumesGetTestJSON-1429214493-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.509121 Oct 24 08:47:37.487575 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 1/1] 10.222.0.26 () {60 vars in 1156 bytes} [Mon Oct 24 08:47:33 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3521 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 24 08:47:37.507399 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_api:SELECT=3 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:47:37.513365 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell1:SELECT=3 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:47:37.514706 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell0:SELECT=3 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:47:37.516934 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell0:SELECT=3 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:47:37.832410 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-9376114f-4d16-458b-a630-cb05561768c1 tempest-VolumesGetTestJSON-1429214493 tempest-VolumesGetTestJSON-1429214493-project] Calling method '.version_select at 0x7f7ef2602c10>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:47:38.261776 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-9376114f-4d16-458b-a630-cb05561768c1 tempest-VolumesGetTestJSON-1429214493 tempest-VolumesGetTestJSON-1429214493-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/0e8e691a-4f60-45e0-a02e-344024ac1031" status: 200 len: 353 microversion: 2.1 time: 0.769389 Oct 24 08:47:38.262749 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 1/2] 10.222.0.26 () {58 vars in 1245 bytes} [Mon Oct 24 08:47:37 2022] GET /compute/v2.1/os-volumes/0e8e691a-4f60-45e0-a02e-344024ac1031 => generated 353 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:47:38.276261 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-ffce4d70-16f6-4959-9597-00fdb3e8e0e6 tempest-VolumesGetTestJSON-1429214493 tempest-VolumesGetTestJSON-1429214493-project] Calling method '.version_select at 0x7f7ef2492d30>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:47:38.381291 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-ffce4d70-16f6-4959-9597-00fdb3e8e0e6 tempest-VolumesGetTestJSON-1429214493 tempest-VolumesGetTestJSON-1429214493-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/0e8e691a-4f60-45e0-a02e-344024ac1031" status: 200 len: 353 microversion: 2.1 time: 0.109375 Oct 24 08:47:38.382263 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1245 bytes} [Mon Oct 24 08:47:38 2022] GET /compute/v2.1/os-volumes/0e8e691a-4f60-45e0-a02e-344024ac1031 => generated 353 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:47:38.402581 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-61401e48-3603-4ce7-83ed-61b9b4eeb5bc tempest-VolumesGetTestJSON-1429214493 tempest-VolumesGetTestJSON-1429214493-project] Calling method '.version_select at 0x7f7ef24cdd30>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:47:38.878545 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-61401e48-3603-4ce7-83ed-61b9b4eeb5bc tempest-VolumesGetTestJSON-1429214493 tempest-VolumesGetTestJSON-1429214493-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/0e8e691a-4f60-45e0-a02e-344024ac1031" status: 202 len: 0 microversion: 2.1 time: 0.480519 Oct 24 08:47:38.881061 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1248 bytes} [Mon Oct 24 08:47:38 2022] DELETE /compute/v2.1/os-volumes/0e8e691a-4f60-45e0-a02e-344024ac1031 => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:47:38.889234 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-e557ab41-93f3-4e74-8f5a-bcd405dbf750 tempest-VolumesGetTestJSON-1429214493 tempest-VolumesGetTestJSON-1429214493-project] Calling method '.version_select at 0x7f7ef2428430>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:47:38.983246 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-800136ec-26c2-4707-8085-663894d9890d tempest-VolumesTestJSON-937602116 tempest-VolumesTestJSON-937602116-project] Calling method '.version_select at 0x7f7ef248a430>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:47:39.056500 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-e557ab41-93f3-4e74-8f5a-bcd405dbf750 tempest-VolumesGetTestJSON-1429214493 tempest-VolumesGetTestJSON-1429214493-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/0e8e691a-4f60-45e0-a02e-344024ac1031" status: 200 len: 352 microversion: 2.1 time: 0.171409 Oct 24 08:47:39.057255 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 3/5] 10.222.0.26 () {58 vars in 1245 bytes} [Mon Oct 24 08:47:38 2022] GET /compute/v2.1/os-volumes/0e8e691a-4f60-45e0-a02e-344024ac1031 => generated 352 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:47:39.150189 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-800136ec-26c2-4707-8085-663894d9890d tempest-VolumesTestJSON-937602116 tempest-VolumesTestJSON-937602116-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/2ba82560-ec26-4b01-a906-12f98e6ec994" status: 200 len: 350 microversion: 2.1 time: 0.171247 Oct 24 08:47:39.150771 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 3/6] 10.222.0.26 () {58 vars in 1245 bytes} [Mon Oct 24 08:47:38 2022] GET /compute/v2.1/os-volumes/2ba82560-ec26-4b01-a906-12f98e6ec994 => generated 350 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:47:40.071914 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-70b2032b-4a57-4fd1-b44e-159c6dafc9ba tempest-VolumesGetTestJSON-1429214493 tempest-VolumesGetTestJSON-1429214493-project] Calling method '.version_select at 0x7f7ef2428af0>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:47:40.103194 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.wsgi [None req-70b2032b-4a57-4fd1-b44e-159c6dafc9ba tempest-VolumesGetTestJSON-1429214493 tempest-VolumesGetTestJSON-1429214493-project] HTTP exception thrown: Volume 0e8e691a-4f60-45e0-a02e-344024ac1031 could not be found. Oct 24 08:47:40.107301 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-70b2032b-4a57-4fd1-b44e-159c6dafc9ba tempest-VolumesGetTestJSON-1429214493 tempest-VolumesGetTestJSON-1429214493-project] Request method failure captured: Oct 24 08:47:40.107301 dv-cinder-master-3-smb devstack@n-api.service[125165]: request: GET /compute/v2.1/os-volumes/0e8e691a-4f60-45e0-a02e-344024ac1031 HTTP/1.1 Oct 24 08:47:40.107301 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept: application/json Oct 24 08:47:40.107301 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept-Encoding: identity Oct 24 08:47:40.107301 dv-cinder-master-3-smb devstack@n-api.service[125165]: Connection: close Oct 24 08:47:40.107301 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Length: 0 Oct 24 08:47:40.107301 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Type: application/json Oct 24 08:47:40.107301 dv-cinder-master-3-smb devstack@n-api.service[125165]: Host: 10.222.0.26 Oct 24 08:47:40.107301 dv-cinder-master-3-smb devstack@n-api.service[125165]: Openstack-System-Scope: None Oct 24 08:47:40.107301 dv-cinder-master-3-smb devstack@n-api.service[125165]: User-Agent: python-urllib3/1.26.12 Oct 24 08:47:40.107301 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Auth-Token: gAAAAABjVlElJ0kLwbzbO8OiE0jbEXKOPzsRO_wENgNXWEfBNyDlA1AOWj208bcs1OauC6g4Bu3LvQVKcrMDli8mEeZL-bOgRCJX8F_gz_W_zi9oCi1Ietr0SKYxk7QHxoqIWqIvDSDO0RP7koNdZYCj06vpNelMUJnAerT_09aOTkAlRiTRN-0 Oct 24 08:47:40.107301 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Id: None Oct 24 08:47:40.107301 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Name: None Oct 24 08:47:40.107301 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Identity-Status: Confirmed Oct 24 08:47:40.107301 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Is-Admin-Project: True Oct 24 08:47:40.107301 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Id: default Oct 24 08:47:40.107301 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Name: Default Oct 24 08:47:40.107301 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Id: 35e1a122b4354e2880b363d6f3815278 Oct 24 08:47:40.107301 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Name: tempest-VolumesGetTestJSON-1429214493 Oct 24 08:47:40.107301 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Role: reader,member Oct 24 08:47:40.107301 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Roles: reader,member Oct 24 08:47:40.108762 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_35e1a122b4354e2880b363d6f3815278", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/35e1a122b4354e2880b363d6f3815278"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/35e1a122b4354e2880b363d6f3815278"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/35e1a122b4354e2880b363d6f3815278"}]}] Oct 24 08:47:40.108762 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant: tempest-VolumesGetTestJSON-1429214493 Oct 24 08:47:40.108762 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Id: 35e1a122b4354e2880b363d6f3815278 Oct 24 08:47:40.108762 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Name: tempest-VolumesGetTestJSON-1429214493 Oct 24 08:47:40.108762 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User: tempest-VolumesGetTestJSON-1429214493-project Oct 24 08:47:40.108762 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Id: default Oct 24 08:47:40.108762 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Name: Default Oct 24 08:47:40.108762 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Id: c300409c40db4636817fd34bfa7c4c77 Oct 24 08:47:40.108762 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Name: tempest-VolumesGetTestJSON-1429214493-project Oct 24 08:47:40.108762 dv-cinder-master-3-smb devstack@n-api.service[125165]: method: Oct 24 08:47:40.108762 dv-cinder-master-3-smb devstack@n-api.service[125165]: exception: Volume 0e8e691a-4f60-45e0-a02e-344024ac1031 could not be found. Oct 24 08:47:40.108762 dv-cinder-master-3-smb devstack@n-api.service[125165]: action_args: {'id': '0e8e691a-4f60-45e0-a02e-344024ac1031'} Oct 24 08:47:40.108762 dv-cinder-master-3-smb devstack@n-api.service[125165]: {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:47:40.112661 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:47:40.112661 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 08:47:40.112661 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 08:47:40.112661 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 08:47:40.112661 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 08:47:40.112661 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 08:47:40.112661 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 08:47:40.112661 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 08:47:40.112661 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 08:47:40.112661 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 08:47:40.112661 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 08:47:40.112661 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 08:47:40.112661 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 08:47:40.112661 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 08:47:40.112661 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 08:47:40.112661 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0e8e691a-4f60-45e0-a02e-344024ac1031 could not be found. (HTTP 404) (Request-ID: req-180073c8-2689-4168-a3e4-abe8a2ab27c1) Oct 24 08:47:40.112661 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:47:40.112661 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:47:40.112661 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:47:40.114913 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:47:40.114913 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 24 08:47:40.114913 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 24 08:47:40.114913 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 08:47:40.114913 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 08:47:40.114913 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 08:47:40.114913 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 08:47:40.114913 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 08:47:40.114913 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 08:47:40.114913 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 08:47:40.114913 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 08:47:40.114913 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 08:47:40.114913 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 08:47:40.114913 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 08:47:40.114913 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 08:47:40.114913 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 08:47:40.114913 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 08:47:40.114913 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 08:47:40.114913 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 08:47:40.116601 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 08:47:40.116601 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 08:47:40.116601 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 08:47:40.116601 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 08:47:40.116601 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0e8e691a-4f60-45e0-a02e-344024ac1031 could not be found. Oct 24 08:47:40.116601 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:47:40.116601 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:47:40.116601 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:47:40.116601 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:47:40.116601 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:47:40.116601 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:47:40.116601 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:47:40.116601 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:47:40.116601 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:47:40.116601 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:47:40.116601 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:47:40.116601 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:47:40.116601 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 24 08:47:40.116601 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:47:40.117990 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0e8e691a-4f60-45e0-a02e-344024ac1031 could not be found. Oct 24 08:47:40.117990 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:47:40.117990 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:47:40.117990 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:47:40.117990 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:47:40.117990 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:47:40.117990 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:47:40.117990 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:47:40.117990 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:47:40.117990 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0e8e691a-4f60-45e0-a02e-344024ac1031 could not be found. Oct 24 08:47:40.117990 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:47:40.117990 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-70b2032b-4a57-4fd1-b44e-159c6dafc9ba tempest-VolumesGetTestJSON-1429214493 tempest-VolumesGetTestJSON-1429214493-project] Returning 404 to user: Volume 0e8e691a-4f60-45e0-a02e-344024ac1031 could not be found. {{(pid=125165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:47:40.117990 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-70b2032b-4a57-4fd1-b44e-159c6dafc9ba tempest-VolumesGetTestJSON-1429214493 tempest-VolumesGetTestJSON-1429214493-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/0e8e691a-4f60-45e0-a02e-344024ac1031" status: 404 len: 109 microversion: 2.1 time: 0.041387 Oct 24 08:47:40.117990 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1245 bytes} [Mon Oct 24 08:47:40 2022] GET /compute/v2.1/os-volumes/0e8e691a-4f60-45e0-a02e-344024ac1031 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:47:40.370694 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-0462f51b-2c12-4576-a008-0ea7b08f08d2 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Action: 'create', calling method: .version_select at 0x7f7ef24cdf70>, body: {"keypair": {"name": "tempest-keypair-1066450027", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCwoID+r2tCxOBlExuaHaJBj68bp33gHpBEdJiRzryvtRnNiUcMUh+z7YmsvNtaB2ruboMtJYx9rz0PETekbATmkQPqdLz91d5/SbNGU4fZyNZExgE7Ok81nFn1kn3zjg=="}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:47:40.485602 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.quota [None req-0462f51b-2c12-4576-a008-0ea7b08f08d2 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Getting quotas for project e3b77fd80fd84c29b4581fda1ff8cef9. Resources: {'key_pairs'} {{(pid=125164) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:47:40.503629 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.quota [None req-0462f51b-2c12-4576-a008-0ea7b08f08d2 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Getting quotas for user 7d793a1f26a3467ea8119e27e3394371 and project e3b77fd80fd84c29b4581fda1ff8cef9. Resources: {'key_pairs'} {{(pid=125164) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:47:40.591925 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-0462f51b-2c12-4576-a008-0ea7b08f08d2 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.324662 Oct 24 08:47:40.592925 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 4/8] 10.222.0.26 () {60 vars in 1159 bytes} [Mon Oct 24 08:47:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:47:40.828694 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-5bb926ba-0529-4514-98d3-50c13b658ea2 tempest-VolumesTestJSON-937602116 tempest-VolumesTestJSON-937602116-project] Calling method '.version_select at 0x7f7ef24114c0>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:47:40.944059 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-5bb926ba-0529-4514-98d3-50c13b658ea2 tempest-VolumesTestJSON-937602116 tempest-VolumesTestJSON-937602116-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/8289606d-377a-4bb7-a822-ca5de597cccc" status: 200 len: 351 microversion: 2.1 time: 0.119067 Oct 24 08:47:40.945013 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 5/9] 10.222.0.26 () {58 vars in 1245 bytes} [Mon Oct 24 08:47:40 2022] GET /compute/v2.1/os-volumes/8289606d-377a-4bb7-a822-ca5de597cccc => generated 351 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:47:42.691482 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-61655a5c-bead-412a-8533-bcb0fd1daec2 tempest-VolumesTestJSON-937602116 tempest-VolumesTestJSON-937602116-project] Calling method '.version_select at 0x7f7ef23b5160>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:47:42.867038 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-61655a5c-bead-412a-8533-bcb0fd1daec2 tempest-VolumesTestJSON-937602116 tempest-VolumesTestJSON-937602116-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/d390fc8e-a820-4ad1-b981-fef8b75ca666" status: 200 len: 350 microversion: 2.1 time: 0.179584 Oct 24 08:47:42.869257 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 5/10] 10.222.0.26 () {58 vars in 1245 bytes} [Mon Oct 24 08:47:42 2022] GET /compute/v2.1/os-volumes/d390fc8e-a820-4ad1-b981-fef8b75ca666 => generated 350 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:47:42.881513 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-474608be-5b19-458a-aebf-806d27460de7 tempest-VolumesTestJSON-937602116 tempest-VolumesTestJSON-937602116-project] Calling method '.version_select at 0x7f7ef2e18310>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:47:43.033777 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-474608be-5b19-458a-aebf-806d27460de7 tempest-VolumesTestJSON-937602116 tempest-VolumesTestJSON-937602116-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.156562 Oct 24 08:47:43.034608 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 6/11] 10.222.0.26 () {58 vars in 1134 bytes} [Mon Oct 24 08:47:42 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:47:43.050198 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-2a6b6fd8-c415-4b1e-9ce5-aaf4e12bee2c tempest-VolumesTestJSON-937602116 tempest-VolumesTestJSON-937602116-project] Calling method '.version_select at 0x7f7ef23b5790>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:47:43.420153 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-2a6b6fd8-c415-4b1e-9ce5-aaf4e12bee2c tempest-VolumesTestJSON-937602116 tempest-VolumesTestJSON-937602116-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.374417 Oct 24 08:47:43.421364 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1149 bytes} [Mon Oct 24 08:47:43 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:47:43.436168 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-39d0d4ca-8def-4453-bed1-75fe4b0cdcf5 tempest-VolumesTestJSON-937602116 tempest-VolumesTestJSON-937602116-project] Calling method '.version_select at 0x7f7ef240f1f0>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:47:43.662323 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-39d0d4ca-8def-4453-bed1-75fe4b0cdcf5 tempest-VolumesTestJSON-937602116 tempest-VolumesTestJSON-937602116-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.230776 Oct 24 08:47:43.674330 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1134 bytes} [Mon Oct 24 08:47:43 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:47:43.676957 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-be35414e-6df6-4442-b5d7-ea100a262cfd tempest-VolumesTestJSON-937602116 tempest-VolumesTestJSON-937602116-project] Calling method '.version_select at 0x7f7ef23b5040>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:47:43.913874 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-be35414e-6df6-4442-b5d7-ea100a262cfd tempest-VolumesTestJSON-937602116 tempest-VolumesTestJSON-937602116-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.240686 Oct 24 08:47:43.915773 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 7/14] 10.222.0.26 () {58 vars in 1167 bytes} [Mon Oct 24 08:47:43 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:47:43.930991 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-2d042271-efd0-49c4-9bc7-b1f13293974f tempest-VolumesTestJSON-937602116 tempest-VolumesTestJSON-937602116-project] Calling method '.version_select at 0x7f7ef2419550>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:47:44.194386 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-2d042271-efd0-49c4-9bc7-b1f13293974f tempest-VolumesTestJSON-937602116 tempest-VolumesTestJSON-937602116-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.268769 Oct 24 08:47:44.196213 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 8/15] 10.222.0.26 () {58 vars in 1170 bytes} [Mon Oct 24 08:47:43 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:47:44.213680 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-c8d54c50-290b-44fb-b477-c22dbfac39a0 tempest-VolumesTestJSON-937602116 tempest-VolumesTestJSON-937602116-project] Calling method '.version_select at 0x7f7ef23c6160>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:47:44.482232 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-c8d54c50-290b-44fb-b477-c22dbfac39a0 tempest-VolumesTestJSON-937602116 tempest-VolumesTestJSON-937602116-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.277223 Oct 24 08:47:44.483529 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 8/16] 10.222.0.26 () {58 vars in 1155 bytes} [Mon Oct 24 08:47:44 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:47:44.497422 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-4483ed8e-fcbe-4536-8da4-4cfc39755c6b tempest-VolumesTestJSON-937602116 tempest-VolumesTestJSON-937602116-project] Calling method '.version_select at 0x7f7ef240f280>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:47:44.639622 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-4483ed8e-fcbe-4536-8da4-4cfc39755c6b tempest-VolumesTestJSON-937602116 tempest-VolumesTestJSON-937602116-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.146573 Oct 24 08:47:44.640864 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 9/17] 10.222.0.26 () {58 vars in 1188 bytes} [Mon Oct 24 08:47:44 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:47:44.656908 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-e7b61d77-16d2-4a2d-947c-34c94f3a9301 tempest-VolumesTestJSON-937602116 tempest-VolumesTestJSON-937602116-project] Calling method '.version_select at 0x7f7ef23c6940>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:47:44.821333 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-e7b61d77-16d2-4a2d-947c-34c94f3a9301 tempest-VolumesTestJSON-937602116 tempest-VolumesTestJSON-937602116-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.170114 Oct 24 08:47:44.822307 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 9/18] 10.222.0.26 () {58 vars in 1155 bytes} [Mon Oct 24 08:47:44 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:47:47.275170 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-5a974c6b-b3d7-4112-bcb8-56c89c891db0 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1712840369", "imageRef": "7eef2d62-12dc-4746-9cbd-870797d39b4d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6bd93b93-0fdc-46fa-884b-c5f169b8b0e5"}], "security_groups": [{"name": "tempest-securitygroup--1899475907"}], "key_name": "tempest-keypair-1066450027", "user_data": "}} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:47:47.871986 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.network.neutron [None req-5a974c6b-b3d7-4112-bcb8-56c89c891db0 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] validate_networks() for [('6bd93b93-0fdc-46fa-884b-c5f169b8b0e5', None, None, None, None, None)] {{(pid=125165) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:47:50.890323 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell0:SELECT=4 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:47:50.890992 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:47:51.275444 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-497fd02a-be12-47c7-ade9-d7f10e358ca1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Action: 'create', calling method: .version_select at 0x7f7ef23c2430>, body: {"keypair": {"name": "tempest-keypair-1645717337", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZPhzVA334WVXHZSj5wyNvqZBUxyybqlmo8nVESlmEyKs1u7UJM5LM/Co/ViGd2qJ/p5m7YB62Gs8vq91jigO2J/Z/XjQAOCSUPfH4JoM5RJI6nM3xtzy1g4uW8DFOZ0Q=="}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:47:51.313382 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.quota [None req-497fd02a-be12-47c7-ade9-d7f10e358ca1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Getting quotas for project 02be1b30677f400788b35b03938e44e5. Resources: {'key_pairs'} {{(pid=125164) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:47:51.330035 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.quota [None req-497fd02a-be12-47c7-ade9-d7f10e358ca1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Getting quotas for user 712e5cf4cc004918817ab1802b9c69d6 and project 02be1b30677f400788b35b03938e44e5. Resources: {'key_pairs'} {{(pid=125164) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:47:51.375937 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-497fd02a-be12-47c7-ade9-d7f10e358ca1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.486518 Oct 24 08:47:51.376882 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 10/19] 10.222.0.26 () {60 vars in 1159 bytes} [Mon Oct 24 08:47:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:47:53.017914 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-5a974c6b-b3d7-4112-bcb8-56c89c891db0 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Flavor limits 0:0:0 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:47:53.019208 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-5a974c6b-b3d7-4112-bcb8-56c89c891db0 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Image limits 0:0:0 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:47:53.019208 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-5a974c6b-b3d7-4112-bcb8-56c89c891db0 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Flavor pref 0:0:0 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:47:53.022253 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-5a974c6b-b3d7-4112-bcb8-56c89c891db0 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Image pref 0:0:0 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:47:53.022253 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-5a974c6b-b3d7-4112-bcb8-56c89c891db0 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:47:53.051238 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5a974c6b-b3d7-4112-bcb8-56c89c891db0 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:47:53.054522 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5a974c6b-b3d7-4112-bcb8-56c89c891db0 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:47:53.069083 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5a974c6b-b3d7-4112-bcb8-56c89c891db0 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:47:53.071617 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5a974c6b-b3d7-4112-bcb8-56c89c891db0 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:47:53.072175 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5a974c6b-b3d7-4112-bcb8-56c89c891db0 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:47:53.074497 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5a974c6b-b3d7-4112-bcb8-56c89c891db0 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:47:53.180860 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.quota [None req-5a974c6b-b3d7-4112-bcb8-56c89c891db0 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Getting quotas for project e3b77fd80fd84c29b4581fda1ff8cef9. Resources: {'ram', 'cores', 'instances'} {{(pid=125165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:47:53.224948 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.quota [None req-5a974c6b-b3d7-4112-bcb8-56c89c891db0 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Getting quotas for user 7d793a1f26a3467ea8119e27e3394371 and project e3b77fd80fd84c29b4581fda1ff8cef9. Resources: {'ram', 'cores', 'instances'} {{(pid=125165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:47:53.254243 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-5a974c6b-b3d7-4112-bcb8-56c89c891db0 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Going to run 1 instances... {{(pid=125165) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:47:53.258454 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-5a974c6b-b3d7-4112-bcb8-56c89c891db0 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7eef2d62-12dc-4746-9cbd-870797d39b4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125165) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:47:53.407671 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-5a974c6b-b3d7-4112-bcb8-56c89c891db0 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 6.138444 Oct 24 08:47:53.412532 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 10/20] 10.222.0.26 () {60 vars in 1147 bytes} [Mon Oct 24 08:47:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 6144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:47:53.429805 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-58df911f-7a02-47cf-83f2-4355fefa1593 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:47:53.444916 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-58df911f-7a02-47cf-83f2-4355fefa1593 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:47:53.801011 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-58df911f-7a02-47cf-83f2-4355fefa1593 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:47:53.856582 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-58df911f-7a02-47cf-83f2-4355fefa1593 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1238 microversion: 2.1 time: 0.430040 Oct 24 08:47:53.859655 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 11/21] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:47:53 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1238 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:47:54.010666 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-4e96992d-a952-426a-8ca5-80747629b6ee tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-790629789", "imageRef": "7eef2d62-12dc-4746-9cbd-870797d39b4d", "flavorRef": "452", "networks": [{"uuid": "fec07734-af18-483d-bf6a-24711c176a2b"}]}} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:47:54.144676 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.network.neutron [None req-4e96992d-a952-426a-8ca5-80747629b6ee tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] validate_networks() for [('fec07734-af18-483d-bf6a-24711c176a2b', None, None, None, None, None)] {{(pid=125165) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:47:54.895739 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-f6c047cb-d3af-47ea-bd79-f49d8558ece4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:47:54.897021 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-f6c047cb-d3af-47ea-bd79-f49d8558ece4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:47:55.282130 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-f6c047cb-d3af-47ea-bd79-f49d8558ece4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:47:55.295590 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-f6c047cb-d3af-47ea-bd79-f49d8558ece4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1238 microversion: 2.1 time: 0.412288 Oct 24 08:47:55.297471 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 12/22] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:47:54 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1238 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:47:56.326937 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-e2621c5c-d138-4733-9beb-9e8297e433d9 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:47:56.327564 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-e2621c5c-d138-4733-9beb-9e8297e433d9 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:47:56.343426 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e2621c5c-d138-4733-9beb-9e8297e433d9 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:47:56.345569 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e2621c5c-d138-4733-9beb-9e8297e433d9 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:47:56.346172 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e2621c5c-d138-4733-9beb-9e8297e433d9 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:47:56.347022 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e2621c5c-d138-4733-9beb-9e8297e433d9 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:47:56.347484 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e2621c5c-d138-4733-9beb-9e8297e433d9 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:47:56.347908 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e2621c5c-d138-4733-9beb-9e8297e433d9 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:47:56.881634 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-e2621c5c-d138-4733-9beb-9e8297e433d9 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:47:56.903348 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-e2621c5c-d138-4733-9beb-9e8297e433d9 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1290 microversion: 2.1 time: 0.586557 Oct 24 08:47:56.904393 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 13/23] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:47:56 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1290 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:47:57.325916 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-4e96992d-a952-426a-8ca5-80747629b6ee tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Flavor limits 0:0:0 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:47:57.326950 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-4e96992d-a952-426a-8ca5-80747629b6ee tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Image limits 0:0:0 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:47:57.327574 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-4e96992d-a952-426a-8ca5-80747629b6ee tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Flavor pref 0:0:0 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:47:57.328124 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-4e96992d-a952-426a-8ca5-80747629b6ee tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Image pref 0:0:0 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:47:57.328720 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-4e96992d-a952-426a-8ca5-80747629b6ee tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:47:57.357522 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4e96992d-a952-426a-8ca5-80747629b6ee tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:47:57.360764 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4e96992d-a952-426a-8ca5-80747629b6ee tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:47:57.366821 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4e96992d-a952-426a-8ca5-80747629b6ee tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:47:57.370222 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4e96992d-a952-426a-8ca5-80747629b6ee tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:47:57.371020 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4e96992d-a952-426a-8ca5-80747629b6ee tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:47:57.371589 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4e96992d-a952-426a-8ca5-80747629b6ee tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:47:57.397780 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-301de89b-c053-45b1-b5aa-9f53efeb5a72 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2119714965", "imageRef": "7eef2d62-12dc-4746-9cbd-870797d39b4d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:47:57.436968 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.quota [None req-4e96992d-a952-426a-8ca5-80747629b6ee tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Getting quotas for project 7fa4a0e9972c4eb1963334ba4ae99a4f. Resources: {'ram', 'cores', 'instances'} {{(pid=125165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:47:57.456142 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.quota [None req-4e96992d-a952-426a-8ca5-80747629b6ee tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Getting quotas for user b002748b80db40358571017d6b42ed09 and project 7fa4a0e9972c4eb1963334ba4ae99a4f. Resources: {'ram', 'cores', 'instances'} {{(pid=125165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:47:57.478902 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-4e96992d-a952-426a-8ca5-80747629b6ee tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Going to run 1 instances... {{(pid=125165) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:47:57.490313 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-4e96992d-a952-426a-8ca5-80747629b6ee tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] [instance: 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7eef2d62-12dc-4746-9cbd-870797d39b4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125165) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:47:57.661792 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-4e96992d-a952-426a-8ca5-80747629b6ee tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.053008 Oct 24 08:47:57.674106 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 11/24] 10.222.0.26 () {60 vars in 1147 bytes} [Mon Oct 24 08:47:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 4066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:47:57.678332 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.network.neutron [None req-301de89b-c053-45b1-b5aa-9f53efeb5a72 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] validate_networks() for [('a81b9f60-d398-4105-9010-f91f1d9988e6', None, None, None, None, None)] {{(pid=125164) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:47:57.702647 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-361f2994-9122-458b-b3ec-59b51efcbabe tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:47:57.724606 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-361f2994-9122-458b-b3ec-59b51efcbabe tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] [instance: 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:47:57.945935 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-361f2994-9122-458b-b3ec-59b51efcbabe tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b002748b80db40358571017d6b42ed09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa4a0e9972c4eb1963334ba4ae99a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:47:57.996617 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-361f2994-9122-458b-b3ec-59b51efcbabe tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] 10.222.0.26 "GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb" status: 200 len: 1214 microversion: 2.1 time: 0.312217 Oct 24 08:47:57.997932 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 12/25] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:47:57 2022] GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb => generated 1214 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:47:58.172482 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-d2a9ca12-50f3-4050-bd63-89867044e5d1 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Action: 'create', calling method: .version_select at 0x7f7ef260dee0>, body: {"keypair": {"name": "tempest-keypair-1859003343", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdjDwfqcvout9p11LYLbZWdq0DeBlurhUNHu07XLXS3k1E2i2wJmo+B4TCPO745NaYvRLQHGPn4tFwfxd8wAEPqcTnY/HBbpoENBtlQUNkW12k2NCjnXCtedfKsgd0JHg=="}} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:47:58.252431 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.quota [None req-d2a9ca12-50f3-4050-bd63-89867044e5d1 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Getting quotas for project 5bca750f880a44988f7324b2f8da3e7b. Resources: {'key_pairs'} {{(pid=125165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:47:58.266851 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.quota [None req-d2a9ca12-50f3-4050-bd63-89867044e5d1 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Getting quotas for user 43af1b9b66804624aff6eef2f435d581 and project 5bca750f880a44988f7324b2f8da3e7b. Resources: {'key_pairs'} {{(pid=125165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:47:58.391288 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-d2a9ca12-50f3-4050-bd63-89867044e5d1 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.388404 Oct 24 08:47:58.394916 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 13/26] 10.222.0.26 () {62 vars in 1200 bytes} [Mon Oct 24 08:47:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 394 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 24 08:47:58.432613 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-f467dd7d-d768-422b-b778-918691f4c3ae tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:47:58.438602 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-f467dd7d-d768-422b-b778-918691f4c3ae tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:47:58.516020 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f467dd7d-d768-422b-b778-918691f4c3ae tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:47:58.516587 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f467dd7d-d768-422b-b778-918691f4c3ae tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:47:58.525281 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f467dd7d-d768-422b-b778-918691f4c3ae tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:47:58.527878 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f467dd7d-d768-422b-b778-918691f4c3ae tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:47:58.528381 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f467dd7d-d768-422b-b778-918691f4c3ae tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:47:58.529902 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f467dd7d-d768-422b-b778-918691f4c3ae tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:47:59.293111 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-f467dd7d-d768-422b-b778-918691f4c3ae tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:47:59.330330 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-f467dd7d-d768-422b-b778-918691f4c3ae tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1296 microversion: 2.1 time: 0.934210 Oct 24 08:47:59.331893 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 14/27] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:47:58 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1296 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:47:59.337559 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-ee9d1bc7-ad1e-472c-8157-7923c971b482 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1166852789", "imageRef": "7eef2d62-12dc-4746-9cbd-870797d39b4d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "af0d0daa-6faa-4e0a-a58b-da03c7bc2818"}], "security_groups": [{"name": "tempest-securitygroup--1753845564"}], "key_name": "tempest-keypair-1645717337", "user_data": "}} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:48:00.445458 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.network.neutron [None req-ee9d1bc7-ad1e-472c-8157-7923c971b482 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] validate_networks() for [('af0d0daa-6faa-4e0a-a58b-da03c7bc2818', None, None, None, None, None)] {{(pid=125165) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:48:01.378348 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-301de89b-c053-45b1-b5aa-9f53efeb5a72 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Flavor limits 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:48:01.379248 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-301de89b-c053-45b1-b5aa-9f53efeb5a72 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Image limits 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:48:01.379740 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-301de89b-c053-45b1-b5aa-9f53efeb5a72 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Flavor pref 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:48:01.380151 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-301de89b-c053-45b1-b5aa-9f53efeb5a72 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Image pref 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:48:01.380734 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-301de89b-c053-45b1-b5aa-9f53efeb5a72 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:48:01.441801 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-301de89b-c053-45b1-b5aa-9f53efeb5a72 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:01.446071 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-301de89b-c053-45b1-b5aa-9f53efeb5a72 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:01.451079 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-301de89b-c053-45b1-b5aa-9f53efeb5a72 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:01.453334 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-301de89b-c053-45b1-b5aa-9f53efeb5a72 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:01.457656 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-301de89b-c053-45b1-b5aa-9f53efeb5a72 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:01.470617 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-301de89b-c053-45b1-b5aa-9f53efeb5a72 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:01.589176 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.quota [None req-301de89b-c053-45b1-b5aa-9f53efeb5a72 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Getting quotas for project f063c719bcda47e6874437d32d284815. Resources: {'ram', 'cores', 'instances'} {{(pid=125164) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:48:01.604182 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.quota [None req-301de89b-c053-45b1-b5aa-9f53efeb5a72 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Getting quotas for user 8695364e58b04d829b12ae1b49757536 and project f063c719bcda47e6874437d32d284815. Resources: {'ram', 'cores', 'instances'} {{(pid=125164) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:48:01.674584 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-301de89b-c053-45b1-b5aa-9f53efeb5a72 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Going to run 1 instances... {{(pid=125164) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:48:01.683006 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-301de89b-c053-45b1-b5aa-9f53efeb5a72 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f2772d7f-d505-44ab-a062-58bd88bd49d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7eef2d62-12dc-4746-9cbd-870797d39b4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125164) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:48:01.904711 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-301de89b-c053-45b1-b5aa-9f53efeb5a72 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.891944 Oct 24 08:48:01.917180 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 14/28] 10.222.0.26 () {60 vars in 1147 bytes} [Mon Oct 24 08:47:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 4906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 08:48:01.977748 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-67056ee1-41ae-4638-8d64-e20e1d11e3e6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:01.978377 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-67056ee1-41ae-4638-8d64-e20e1d11e3e6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] [instance: 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:02.033349 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-67056ee1-41ae-4638-8d64-e20e1d11e3e6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:02.034055 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-67056ee1-41ae-4638-8d64-e20e1d11e3e6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:02.035000 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-67056ee1-41ae-4638-8d64-e20e1d11e3e6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:02.036645 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-67056ee1-41ae-4638-8d64-e20e1d11e3e6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:02.037299 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-67056ee1-41ae-4638-8d64-e20e1d11e3e6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:02.038027 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-67056ee1-41ae-4638-8d64-e20e1d11e3e6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:02.788375 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-67056ee1-41ae-4638-8d64-e20e1d11e3e6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b002748b80db40358571017d6b42ed09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa4a0e9972c4eb1963334ba4ae99a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:02.797719 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-67056ee1-41ae-4638-8d64-e20e1d11e3e6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] 10.222.0.26 "GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb" status: 200 len: 1272 microversion: 2.1 time: 0.878733 Oct 24 08:48:02.798216 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 15/29] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:01 2022] GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb => generated 1272 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:02.832730 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-b4f7e72e-368f-47a0-9403-86a04e44002d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:02.834117 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-b4f7e72e-368f-47a0-9403-86a04e44002d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:02.868741 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b4f7e72e-368f-47a0-9403-86a04e44002d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:02.876788 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b4f7e72e-368f-47a0-9403-86a04e44002d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:02.876788 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b4f7e72e-368f-47a0-9403-86a04e44002d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:02.880156 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b4f7e72e-368f-47a0-9403-86a04e44002d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:02.880669 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b4f7e72e-368f-47a0-9403-86a04e44002d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:02.881160 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b4f7e72e-368f-47a0-9403-86a04e44002d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:04.063116 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-b4f7e72e-368f-47a0-9403-86a04e44002d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:04.104927 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-b4f7e72e-368f-47a0-9403-86a04e44002d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1364 microversion: 2.1 time: 1.294512 Oct 24 08:48:04.108575 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 16/30] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:02 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1364 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:04.119706 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-21871bac-b293-4ffe-9a76-4e3e444471dc tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:04.120799 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-21871bac-b293-4ffe-9a76-4e3e444471dc tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f2772d7f-d505-44ab-a062-58bd88bd49d3] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:04.148404 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-21871bac-b293-4ffe-9a76-4e3e444471dc tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:04.150761 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-21871bac-b293-4ffe-9a76-4e3e444471dc tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:04.151560 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-21871bac-b293-4ffe-9a76-4e3e444471dc tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:04.152968 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-21871bac-b293-4ffe-9a76-4e3e444471dc tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:04.154166 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-21871bac-b293-4ffe-9a76-4e3e444471dc tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:04.154609 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-21871bac-b293-4ffe-9a76-4e3e444471dc tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:04.894686 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-21871bac-b293-4ffe-9a76-4e3e444471dc tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:04.899996 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-ee9d1bc7-ad1e-472c-8157-7923c971b482 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Flavor limits 0:0:0 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:48:04.900553 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-ee9d1bc7-ad1e-472c-8157-7923c971b482 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Image limits 0:0:0 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:48:04.900998 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-ee9d1bc7-ad1e-472c-8157-7923c971b482 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Flavor pref 0:0:0 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:48:04.902429 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-ee9d1bc7-ad1e-472c-8157-7923c971b482 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Image pref 0:0:0 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:48:04.902940 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-ee9d1bc7-ad1e-472c-8157-7923c971b482 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:48:04.936510 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-21871bac-b293-4ffe-9a76-4e3e444471dc tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3" status: 200 len: 1274 microversion: 2.1 time: 0.826602 Oct 24 08:48:04.966107 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 17/31] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:04 2022] GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3 => generated 1274 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:04.970340 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ee9d1bc7-ad1e-472c-8157-7923c971b482 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:04.970865 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ee9d1bc7-ad1e-472c-8157-7923c971b482 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:04.971312 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ee9d1bc7-ad1e-472c-8157-7923c971b482 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:04.986999 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-7ebfd4a8-bc3d-47e6-8c7d-381551d4ceff tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:04.987503 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-7ebfd4a8-bc3d-47e6-8c7d-381551d4ceff tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] [instance: 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:04.991005 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ee9d1bc7-ad1e-472c-8157-7923c971b482 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:04.991529 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ee9d1bc7-ad1e-472c-8157-7923c971b482 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:04.991990 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ee9d1bc7-ad1e-472c-8157-7923c971b482 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:05.018927 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7ebfd4a8-bc3d-47e6-8c7d-381551d4ceff tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:05.019366 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7ebfd4a8-bc3d-47e6-8c7d-381551d4ceff tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:05.019882 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7ebfd4a8-bc3d-47e6-8c7d-381551d4ceff tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:05.020601 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7ebfd4a8-bc3d-47e6-8c7d-381551d4ceff tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:05.021066 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7ebfd4a8-bc3d-47e6-8c7d-381551d4ceff tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:05.021499 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7ebfd4a8-bc3d-47e6-8c7d-381551d4ceff tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:05.084904 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.quota [None req-ee9d1bc7-ad1e-472c-8157-7923c971b482 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Getting quotas for project 02be1b30677f400788b35b03938e44e5. Resources: {'ram', 'cores', 'instances'} {{(pid=125165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:48:05.107942 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.quota [None req-ee9d1bc7-ad1e-472c-8157-7923c971b482 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Getting quotas for user 712e5cf4cc004918817ab1802b9c69d6 and project 02be1b30677f400788b35b03938e44e5. Resources: {'ram', 'cores', 'instances'} {{(pid=125165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:48:05.167406 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-ee9d1bc7-ad1e-472c-8157-7923c971b482 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Going to run 1 instances... {{(pid=125165) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:48:05.181515 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-ee9d1bc7-ad1e-472c-8157-7923c971b482 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7eef2d62-12dc-4746-9cbd-870797d39b4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125165) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:48:05.354490 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-ee9d1bc7-ad1e-472c-8157-7923c971b482 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 6.021335 Oct 24 08:48:05.363092 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 15/32] 10.222.0.26 () {60 vars in 1147 bytes} [Mon Oct 24 08:47:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 6031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:48:05.369365 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-6d78eafb-c297-45bc-8334-e01baa6b2fa5 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:05.370213 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-6d78eafb-c297-45bc-8334-e01baa6b2fa5 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:05.383287 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6d78eafb-c297-45bc-8334-e01baa6b2fa5 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:05.384143 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6d78eafb-c297-45bc-8334-e01baa6b2fa5 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:05.384840 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6d78eafb-c297-45bc-8334-e01baa6b2fa5 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:05.385695 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6d78eafb-c297-45bc-8334-e01baa6b2fa5 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:05.386280 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6d78eafb-c297-45bc-8334-e01baa6b2fa5 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:05.386945 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6d78eafb-c297-45bc-8334-e01baa6b2fa5 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:05.823837 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-7ebfd4a8-bc3d-47e6-8c7d-381551d4ceff tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b002748b80db40358571017d6b42ed09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa4a0e9972c4eb1963334ba4ae99a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:05.838016 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-7ebfd4a8-bc3d-47e6-8c7d-381551d4ceff tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] 10.222.0.26 "GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb" status: 200 len: 1272 microversion: 2.1 time: 0.870649 Oct 24 08:48:05.855296 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 18/33] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:04 2022] GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb => generated 1272 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:05.891498 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-b6d3a8e7-ec88-4e14-b051-c3e45b8603de tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-573873192", "imageRef": "7eef2d62-12dc-4746-9cbd-870797d39b4d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:48:06.066110 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.network.neutron [None req-b6d3a8e7-ec88-4e14-b051-c3e45b8603de tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] validate_networks() for [('a81b9f60-d398-4105-9010-f91f1d9988e6', None, None, None, None, None)] {{(pid=125164) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:48:08.373996 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-6d78eafb-c297-45bc-8334-e01baa6b2fa5 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:08.394738 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-6d78eafb-c297-45bc-8334-e01baa6b2fa5 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1364 microversion: 2.1 time: 3.029953 Oct 24 08:48:08.397968 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 16/34] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:05 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1364 bytes in 3034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:08.441476 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-57f379a3-05a7-48fe-90b7-9a43f0cb94ca tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:08.444175 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-57f379a3-05a7-48fe-90b7-9a43f0cb94ca tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:08.466461 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-57f379a3-05a7-48fe-90b7-9a43f0cb94ca tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:08.467661 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-57f379a3-05a7-48fe-90b7-9a43f0cb94ca tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:08.469786 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-57f379a3-05a7-48fe-90b7-9a43f0cb94ca tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:08.473164 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-57f379a3-05a7-48fe-90b7-9a43f0cb94ca tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:08.475253 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-57f379a3-05a7-48fe-90b7-9a43f0cb94ca tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:08.479025 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-57f379a3-05a7-48fe-90b7-9a43f0cb94ca tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:08.769635 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-57f379a3-05a7-48fe-90b7-9a43f0cb94ca tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:08.786358 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-57f379a3-05a7-48fe-90b7-9a43f0cb94ca tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1" status: 200 len: 1294 microversion: 2.1 time: 0.361662 Oct 24 08:48:08.787221 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 17/35] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:08 2022] GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 => generated 1294 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:08.821941 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-13f6c564-01e5-4e12-8aa3-e3994ee32c89 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:08.824221 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-13f6c564-01e5-4e12-8aa3-e3994ee32c89 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] [instance: 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:08.842791 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-13f6c564-01e5-4e12-8aa3-e3994ee32c89 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:08.846168 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-13f6c564-01e5-4e12-8aa3-e3994ee32c89 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:08.847142 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-13f6c564-01e5-4e12-8aa3-e3994ee32c89 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:08.848046 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-13f6c564-01e5-4e12-8aa3-e3994ee32c89 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:08.850847 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-13f6c564-01e5-4e12-8aa3-e3994ee32c89 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:08.853298 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-13f6c564-01e5-4e12-8aa3-e3994ee32c89 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:09.651743 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-13f6c564-01e5-4e12-8aa3-e3994ee32c89 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b002748b80db40358571017d6b42ed09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa4a0e9972c4eb1963334ba4ae99a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:09.663236 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-13f6c564-01e5-4e12-8aa3-e3994ee32c89 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] 10.222.0.26 "GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb" status: 200 len: 1314 microversion: 2.1 time: 0.854981 Oct 24 08:48:09.663863 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 18/36] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:08 2022] GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb => generated 1314 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:09.693032 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-b6d3a8e7-ec88-4e14-b051-c3e45b8603de tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Flavor limits 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:48:09.693580 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-b6d3a8e7-ec88-4e14-b051-c3e45b8603de tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Image limits 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:48:09.693927 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-b6d3a8e7-ec88-4e14-b051-c3e45b8603de tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Flavor pref 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:48:09.694338 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-b6d3a8e7-ec88-4e14-b051-c3e45b8603de tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Image pref 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:48:09.694818 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-b6d3a8e7-ec88-4e14-b051-c3e45b8603de tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:48:09.714259 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b6d3a8e7-ec88-4e14-b051-c3e45b8603de tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:09.714789 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b6d3a8e7-ec88-4e14-b051-c3e45b8603de tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:09.715242 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b6d3a8e7-ec88-4e14-b051-c3e45b8603de tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:09.715974 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b6d3a8e7-ec88-4e14-b051-c3e45b8603de tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:09.716468 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b6d3a8e7-ec88-4e14-b051-c3e45b8603de tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:09.731542 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b6d3a8e7-ec88-4e14-b051-c3e45b8603de tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:09.800243 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.quota [None req-b6d3a8e7-ec88-4e14-b051-c3e45b8603de tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Getting quotas for project f063c719bcda47e6874437d32d284815. Resources: {'ram', 'cores', 'instances'} {{(pid=125164) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:48:09.811623 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.quota [None req-b6d3a8e7-ec88-4e14-b051-c3e45b8603de tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Getting quotas for user 8695364e58b04d829b12ae1b49757536 and project f063c719bcda47e6874437d32d284815. Resources: {'ram', 'cores', 'instances'} {{(pid=125164) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:48:09.840743 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-b6d3a8e7-ec88-4e14-b051-c3e45b8603de tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Going to run 1 instances... {{(pid=125164) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:48:09.843109 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-b6d3a8e7-ec88-4e14-b051-c3e45b8603de tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7eef2d62-12dc-4746-9cbd-870797d39b4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125164) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:48:09.992577 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-b6d3a8e7-ec88-4e14-b051-c3e45b8603de tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.140388 Oct 24 08:48:10.010351 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 19/37] 10.222.0.26 () {60 vars in 1147 bytes} [Mon Oct 24 08:48:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 4159 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:48:10.020742 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-ad1bf8a8-3393-439a-a7ee-2f96ad5398ff tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:10.027738 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-ad1bf8a8-3393-439a-a7ee-2f96ad5398ff tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:10.065268 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ad1bf8a8-3393-439a-a7ee-2f96ad5398ff tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:10.065826 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ad1bf8a8-3393-439a-a7ee-2f96ad5398ff tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:10.066276 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ad1bf8a8-3393-439a-a7ee-2f96ad5398ff tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:10.074906 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ad1bf8a8-3393-439a-a7ee-2f96ad5398ff tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:10.075490 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ad1bf8a8-3393-439a-a7ee-2f96ad5398ff tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:10.079401 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ad1bf8a8-3393-439a-a7ee-2f96ad5398ff tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:10.111180 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-f17c1f45-9cf2-4efc-a807-1906212dcc0a req-767519fc-f8fc-4f57-80b7-d865096d67cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "031a03be-3f3b-46dd-944c-6e68a9d8b09a", "tag": "634028ec-acae-487c-82c9-606115b581ba"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:48:10.164400 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-f17c1f45-9cf2-4efc-a807-1906212dcc0a req-767519fc-f8fc-4f57-80b7-d865096d67cb service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:10.165259 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-f17c1f45-9cf2-4efc-a807-1906212dcc0a req-767519fc-f8fc-4f57-80b7-d865096d67cb service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:10.165697 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-f17c1f45-9cf2-4efc-a807-1906212dcc0a req-767519fc-f8fc-4f57-80b7-d865096d67cb service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:10.234419 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-f17c1f45-9cf2-4efc-a807-1906212dcc0a req-767519fc-f8fc-4f57-80b7-d865096d67cb service nova] Creating event network-changed:634028ec-acae-487c-82c9-606115b581ba for instance 031a03be-3f3b-46dd-944c-6e68a9d8b09a on hv-cinder-maste Oct 24 08:48:10.235026 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-f17c1f45-9cf2-4efc-a807-1906212dcc0a req-767519fc-f8fc-4f57-80b7-d865096d67cb service nova] Acquiring lock "compute-rpcapi-router" {{(pid=125165) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 24 08:48:10.235421 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-f17c1f45-9cf2-4efc-a807-1906212dcc0a req-767519fc-f8fc-4f57-80b7-d865096d67cb service nova] Acquired lock "compute-rpcapi-router" {{(pid=125165) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 24 08:48:10.247821 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-92855b90-d49d-4aff-8e00-d9262f773c41 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:10.249356 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-92855b90-d49d-4aff-8e00-d9262f773c41 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:10.251256 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-92855b90-d49d-4aff-8e00-d9262f773c41 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:10.252237 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-92855b90-d49d-4aff-8e00-d9262f773c41 None None] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:10.252799 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-92855b90-d49d-4aff-8e00-d9262f773c41 None None] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:10.253131 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-92855b90-d49d-4aff-8e00-d9262f773c41 None None] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:10.299656 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.compute.rpcapi [None req-92855b90-d49d-4aff-8e00-d9262f773c41 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 24 08:48:10.300767 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-92855b90-d49d-4aff-8e00-d9262f773c41 None None] Releasing lock "compute-rpcapi-router" {{(pid=125165) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 24 08:48:10.329166 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-92855b90-d49d-4aff-8e00-d9262f773c41 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.663842 Oct 24 08:48:10.330111 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 19/38] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:48:10.350995 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-0a56b36a-f3ac-4a33-8740-25c48f29fefc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:10.359290 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-0a56b36a-f3ac-4a33-8740-25c48f29fefc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:10.393966 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0a56b36a-f3ac-4a33-8740-25c48f29fefc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:10.395664 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0a56b36a-f3ac-4a33-8740-25c48f29fefc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:10.396582 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0a56b36a-f3ac-4a33-8740-25c48f29fefc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:10.408599 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0a56b36a-f3ac-4a33-8740-25c48f29fefc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:10.409461 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0a56b36a-f3ac-4a33-8740-25c48f29fefc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:10.412035 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0a56b36a-f3ac-4a33-8740-25c48f29fefc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:10.879945 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-0a56b36a-f3ac-4a33-8740-25c48f29fefc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:10.892920 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-0a56b36a-f3ac-4a33-8740-25c48f29fefc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1" status: 200 len: 1300 microversion: 2.1 time: 0.560985 Oct 24 08:48:10.896131 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 20/39] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:10 2022] GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 => generated 1300 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:10.909968 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-7adf9e82-41a5-492b-b335-ea76dbe4f526 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:10.921706 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-7adf9e82-41a5-492b-b335-ea76dbe4f526 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:11.053016 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-7adf9e82-41a5-492b-b335-ea76dbe4f526 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:11.065611 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-7adf9e82-41a5-492b-b335-ea76dbe4f526 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1221 microversion: 2.1 time: 0.167923 Oct 24 08:48:11.069983 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 21/40] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:10 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1221 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:11.090519 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-25597742-3394-438c-a051-863995461cfe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-948572954", "imageRef": "7eef2d62-12dc-4746-9cbd-870797d39b4d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "727ab62e-2508-4fac-97c2-cc662889b0bb"}], "security_groups": [{"name": "tempest-securitygroup--197977411"}], "key_name": "tempest-keypair-1859003343", "user_data": "}} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:48:11.198584 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-ad1bf8a8-3393-439a-a7ee-2f96ad5398ff tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:11.214535 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-ad1bf8a8-3393-439a-a7ee-2f96ad5398ff tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1364 microversion: 2.1 time: 1.202721 Oct 24 08:48:11.217186 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 20/41] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:10 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1364 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:11.230366 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-4b3e90f3-8e60-4dfc-b5bf-dde26c4fa554 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:11.234899 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-4b3e90f3-8e60-4dfc-b5bf-dde26c4fa554 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] [instance: 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:11.265677 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4b3e90f3-8e60-4dfc-b5bf-dde26c4fa554 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:11.267149 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4b3e90f3-8e60-4dfc-b5bf-dde26c4fa554 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:11.268579 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4b3e90f3-8e60-4dfc-b5bf-dde26c4fa554 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:11.276884 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4b3e90f3-8e60-4dfc-b5bf-dde26c4fa554 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:11.277856 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4b3e90f3-8e60-4dfc-b5bf-dde26c4fa554 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:11.280480 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4b3e90f3-8e60-4dfc-b5bf-dde26c4fa554 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:11.611947 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.network.neutron [None req-25597742-3394-438c-a051-863995461cfe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] validate_networks() for [('727ab62e-2508-4fac-97c2-cc662889b0bb', None, None, None, None, None)] {{(pid=125165) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:48:11.978059 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-4b3e90f3-8e60-4dfc-b5bf-dde26c4fa554 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b002748b80db40358571017d6b42ed09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa4a0e9972c4eb1963334ba4ae99a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:11.992375 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-4b3e90f3-8e60-4dfc-b5bf-dde26c4fa554 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] 10.222.0.26 "GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb" status: 200 len: 1314 microversion: 2.1 time: 0.772966 Oct 24 08:48:11.994322 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 21/42] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:11 2022] GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb => generated 1314 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:12.001229 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-33360aef-52c8-4993-9154-6f3e98e14e81 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:12.002480 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-33360aef-52c8-4993-9154-6f3e98e14e81 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:12.012303 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-33360aef-52c8-4993-9154-6f3e98e14e81 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:12.012940 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-33360aef-52c8-4993-9154-6f3e98e14e81 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:12.013739 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-33360aef-52c8-4993-9154-6f3e98e14e81 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:12.014708 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-33360aef-52c8-4993-9154-6f3e98e14e81 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:12.015315 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-33360aef-52c8-4993-9154-6f3e98e14e81 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:12.015845 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-33360aef-52c8-4993-9154-6f3e98e14e81 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:12.293958 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-33360aef-52c8-4993-9154-6f3e98e14e81 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:12.328272 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-33360aef-52c8-4993-9154-6f3e98e14e81 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1" status: 200 len: 1300 microversion: 2.1 time: 0.332653 Oct 24 08:48:12.329454 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 22/43] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:11 2022] GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 => generated 1300 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:12.335979 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-911dcfb4-c18d-4b8e-918d-292fc97af00b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:12.336996 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-911dcfb4-c18d-4b8e-918d-292fc97af00b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:12.357111 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-911dcfb4-c18d-4b8e-918d-292fc97af00b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:12.358049 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-911dcfb4-c18d-4b8e-918d-292fc97af00b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:12.358880 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-911dcfb4-c18d-4b8e-918d-292fc97af00b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:12.360032 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-911dcfb4-c18d-4b8e-918d-292fc97af00b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:12.360836 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-911dcfb4-c18d-4b8e-918d-292fc97af00b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:12.361580 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-911dcfb4-c18d-4b8e-918d-292fc97af00b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:12.651498 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-911dcfb4-c18d-4b8e-918d-292fc97af00b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:12.664222 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-911dcfb4-c18d-4b8e-918d-292fc97af00b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1273 microversion: 2.1 time: 0.332256 Oct 24 08:48:12.686852 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 23/44] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:12 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1273 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:12.693183 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-97c83d7c-6285-4ca1-882e-f729dce8586d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:12.721585 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-97c83d7c-6285-4ca1-882e-f729dce8586d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:12.746351 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-97c83d7c-6285-4ca1-882e-f729dce8586d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:12.750048 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-97c83d7c-6285-4ca1-882e-f729dce8586d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:12.752344 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-97c83d7c-6285-4ca1-882e-f729dce8586d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:12.755241 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-97c83d7c-6285-4ca1-882e-f729dce8586d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:12.756703 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-97c83d7c-6285-4ca1-882e-f729dce8586d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:12.757405 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-97c83d7c-6285-4ca1-882e-f729dce8586d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:13.320805 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-97c83d7c-6285-4ca1-882e-f729dce8586d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:13.334917 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-97c83d7c-6285-4ca1-882e-f729dce8586d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1364 microversion: 2.1 time: 0.646331 Oct 24 08:48:13.335720 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 24/45] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:12 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1364 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:13.340640 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-0d40b982-3a65-47c9-ba47-0ef2892cc23f tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:13.341253 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-0d40b982-3a65-47c9-ba47-0ef2892cc23f tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] [instance: 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:13.357360 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-25597742-3394-438c-a051-863995461cfe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Flavor limits 0:0:0 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:48:13.357865 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-25597742-3394-438c-a051-863995461cfe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Image limits 0:0:0 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:48:13.358499 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-25597742-3394-438c-a051-863995461cfe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Flavor pref 0:0:0 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:48:13.358961 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-25597742-3394-438c-a051-863995461cfe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Image pref 0:0:0 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:48:13.360453 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-25597742-3394-438c-a051-863995461cfe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:48:13.361685 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0d40b982-3a65-47c9-ba47-0ef2892cc23f tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:13.362200 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0d40b982-3a65-47c9-ba47-0ef2892cc23f tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:13.362751 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0d40b982-3a65-47c9-ba47-0ef2892cc23f tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:13.367408 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0d40b982-3a65-47c9-ba47-0ef2892cc23f tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:13.367905 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0d40b982-3a65-47c9-ba47-0ef2892cc23f tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:13.368534 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0d40b982-3a65-47c9-ba47-0ef2892cc23f tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:13.402779 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-25597742-3394-438c-a051-863995461cfe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:13.403297 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-25597742-3394-438c-a051-863995461cfe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:13.408662 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-25597742-3394-438c-a051-863995461cfe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:13.414773 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-25597742-3394-438c-a051-863995461cfe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:13.418402 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-25597742-3394-438c-a051-863995461cfe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:13.422056 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-25597742-3394-438c-a051-863995461cfe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:13.511515 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.quota [None req-25597742-3394-438c-a051-863995461cfe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Getting quotas for project 5bca750f880a44988f7324b2f8da3e7b. Resources: {'ram', 'cores', 'instances'} {{(pid=125165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:48:13.519157 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.quota [None req-25597742-3394-438c-a051-863995461cfe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Getting quotas for user 43af1b9b66804624aff6eef2f435d581 and project 5bca750f880a44988f7324b2f8da3e7b. Resources: {'ram', 'cores', 'instances'} {{(pid=125165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:48:13.537742 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-25597742-3394-438c-a051-863995461cfe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Going to run 1 instances... {{(pid=125165) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:48:13.541253 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-25597742-3394-438c-a051-863995461cfe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7eef2d62-12dc-4746-9cbd-870797d39b4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125165) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:48:13.559397 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:48:13.638491 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-25597742-3394-438c-a051-863995461cfe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.566678 Oct 24 08:48:13.639646 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 22/46] 10.222.0.26 () {62 vars in 1188 bytes} [Mon Oct 24 08:48:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 2569 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 24 08:48:13.645447 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-063604a5-afb7-4687-9ad8-d3e7bd040427 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:13.648157 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-063604a5-afb7-4687-9ad8-d3e7bd040427 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:13.656233 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-063604a5-afb7-4687-9ad8-d3e7bd040427 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:13.657422 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-063604a5-afb7-4687-9ad8-d3e7bd040427 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:13.658011 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-063604a5-afb7-4687-9ad8-d3e7bd040427 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:13.659550 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-063604a5-afb7-4687-9ad8-d3e7bd040427 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:13.660405 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-063604a5-afb7-4687-9ad8-d3e7bd040427 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:13.660974 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-063604a5-afb7-4687-9ad8-d3e7bd040427 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:13.868775 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-0d40b982-3a65-47c9-ba47-0ef2892cc23f tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b002748b80db40358571017d6b42ed09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa4a0e9972c4eb1963334ba4ae99a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:13.883625 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-0d40b982-3a65-47c9-ba47-0ef2892cc23f tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] 10.222.0.26 "GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb" status: 200 len: 1314 microversion: 2.1 time: 0.539784 Oct 24 08:48:13.886182 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 25/47] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:13 2022] GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb => generated 1314 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:13.895248 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-c3708fab-9541-4c16-9a64-3641d6aa686c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:13.895862 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-c3708fab-9541-4c16-9a64-3641d6aa686c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:14.031737 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-c3708fab-9541-4c16-9a64-3641d6aa686c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:14.045714 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-c3708fab-9541-4c16-9a64-3641d6aa686c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:14.051438 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-c3708fab-9541-4c16-9a64-3641d6aa686c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:14.052929 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-c3708fab-9541-4c16-9a64-3641d6aa686c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1281 microversion: 2.20 time: 0.165406 Oct 24 08:48:14.053276 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 26/48] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:48:13 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1281 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:48:14.062321 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-46791a73-a9f2-450d-9538-a0b3d4db563f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:14.062968 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-46791a73-a9f2-450d-9538-a0b3d4db563f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:14.091890 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-46791a73-a9f2-450d-9538-a0b3d4db563f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:14.094653 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-46791a73-a9f2-450d-9538-a0b3d4db563f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:14.095366 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-46791a73-a9f2-450d-9538-a0b3d4db563f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:14.097638 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-46791a73-a9f2-450d-9538-a0b3d4db563f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:14.098347 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-46791a73-a9f2-450d-9538-a0b3d4db563f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:14.099797 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-46791a73-a9f2-450d-9538-a0b3d4db563f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:14.387678 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-46791a73-a9f2-450d-9538-a0b3d4db563f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:14.395614 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-46791a73-a9f2-450d-9538-a0b3d4db563f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1273 microversion: 2.1 time: 0.338842 Oct 24 08:48:14.396193 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 27/49] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:14 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1273 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:14.406677 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-d0e6bea4-cd60-4481-8b0e-b6180531edab tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:14.407333 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-d0e6bea4-cd60-4481-8b0e-b6180531edab tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:14.425110 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d0e6bea4-cd60-4481-8b0e-b6180531edab tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:14.425608 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d0e6bea4-cd60-4481-8b0e-b6180531edab tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:14.426795 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d0e6bea4-cd60-4481-8b0e-b6180531edab tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:14.427707 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d0e6bea4-cd60-4481-8b0e-b6180531edab tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:14.429047 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d0e6bea4-cd60-4481-8b0e-b6180531edab tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:14.429047 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d0e6bea4-cd60-4481-8b0e-b6180531edab tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:14.493826 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-063604a5-afb7-4687-9ad8-d3e7bd040427 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:14.500744 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell1:SELECT=47 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:48:14.503068 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-063604a5-afb7-4687-9ad8-d3e7bd040427 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1" status: 200 len: 1368 microversion: 2.1 time: 0.861507 Oct 24 08:48:14.504240 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 23/50] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:13 2022] GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 => generated 1368 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:14.509432 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-92f8375a-f7c6-4be2-bf34-a2e5d921b8ee req-101de4e6-769a-4b70-ab00-c06e4370c085 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ca61184-c71a-4d17-bc49-b99f4d5fbbfb", "tag": "e6fd644c-236f-4c83-9c3a-375d9c0e8e0b"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:48:14.520336 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-92f8375a-f7c6-4be2-bf34-a2e5d921b8ee req-101de4e6-769a-4b70-ab00-c06e4370c085 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:14.521195 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-92f8375a-f7c6-4be2-bf34-a2e5d921b8ee req-101de4e6-769a-4b70-ab00-c06e4370c085 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:14.521631 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-92f8375a-f7c6-4be2-bf34-a2e5d921b8ee req-101de4e6-769a-4b70-ab00-c06e4370c085 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:14.534281 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-92f8375a-f7c6-4be2-bf34-a2e5d921b8ee req-101de4e6-769a-4b70-ab00-c06e4370c085 service nova] Creating event network-changed:e6fd644c-236f-4c83-9c3a-375d9c0e8e0b for instance 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb on hv-cinder-maste Oct 24 08:48:14.543301 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-92f8375a-f7c6-4be2-bf34-a2e5d921b8ee req-101de4e6-769a-4b70-ab00-c06e4370c085 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037553 Oct 24 08:48:14.548613 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 24/51] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:48:14.875389 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-d0e6bea4-cd60-4481-8b0e-b6180531edab tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:14.887479 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-d0e6bea4-cd60-4481-8b0e-b6180531edab tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1364 microversion: 2.1 time: 0.487083 Oct 24 08:48:14.888399 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 28/52] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:14 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1364 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:14.916156 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-c67e3f50-9384-4446-9a9f-f6c087300f9e tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:14.917964 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-c67e3f50-9384-4446-9a9f-f6c087300f9e tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] [instance: 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:14.927353 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c67e3f50-9384-4446-9a9f-f6c087300f9e tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:14.932816 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c67e3f50-9384-4446-9a9f-f6c087300f9e tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:14.933342 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c67e3f50-9384-4446-9a9f-f6c087300f9e tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:14.934086 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c67e3f50-9384-4446-9a9f-f6c087300f9e tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:14.934554 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c67e3f50-9384-4446-9a9f-f6c087300f9e tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:14.935007 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c67e3f50-9384-4446-9a9f-f6c087300f9e tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:15.083995 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-3e7d63c7-9ebf-4f3b-b656-85990472def0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:15.085567 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-3e7d63c7-9ebf-4f3b-b656-85990472def0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:15.097568 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3e7d63c7-9ebf-4f3b-b656-85990472def0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:15.098451 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3e7d63c7-9ebf-4f3b-b656-85990472def0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:15.099372 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3e7d63c7-9ebf-4f3b-b656-85990472def0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:15.101526 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3e7d63c7-9ebf-4f3b-b656-85990472def0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:15.102821 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3e7d63c7-9ebf-4f3b-b656-85990472def0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:15.103607 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3e7d63c7-9ebf-4f3b-b656-85990472def0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:15.248408 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-3e7d63c7-9ebf-4f3b-b656-85990472def0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:15.266156 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-3e7d63c7-9ebf-4f3b-b656-85990472def0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:15.270408 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-3e7d63c7-9ebf-4f3b-b656-85990472def0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:15.272892 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-3e7d63c7-9ebf-4f3b-b656-85990472def0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1285 microversion: 2.20 time: 0.194134 Oct 24 08:48:15.276398 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 29/53] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:48:15 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1285 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:48:15.361541 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-c67e3f50-9384-4446-9a9f-f6c087300f9e tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b002748b80db40358571017d6b42ed09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa4a0e9972c4eb1963334ba4ae99a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:15.378293 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-c67e3f50-9384-4446-9a9f-f6c087300f9e tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] 10.222.0.26 "GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb" status: 200 len: 1314 microversion: 2.1 time: 0.467205 Oct 24 08:48:15.379262 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 25/54] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:14 2022] GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:15.418925 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-85575984-8bf4-48d5-be37-6d731b95e53e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:15.419632 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-85575984-8bf4-48d5-be37-6d731b95e53e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:15.426817 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-85575984-8bf4-48d5-be37-6d731b95e53e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:15.427966 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-85575984-8bf4-48d5-be37-6d731b95e53e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:15.428753 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-85575984-8bf4-48d5-be37-6d731b95e53e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:15.429614 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-85575984-8bf4-48d5-be37-6d731b95e53e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:15.430201 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-85575984-8bf4-48d5-be37-6d731b95e53e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:15.430682 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-85575984-8bf4-48d5-be37-6d731b95e53e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:15.760586 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-85575984-8bf4-48d5-be37-6d731b95e53e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:15.771892 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-85575984-8bf4-48d5-be37-6d731b95e53e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1281 microversion: 2.1 time: 0.355797 Oct 24 08:48:15.772864 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 26/55] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:15 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1281 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:48:15.785003 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-e106fa5f-1c8a-476e-bcba-3d410ed155cc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:15.785980 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-e106fa5f-1c8a-476e-bcba-3d410ed155cc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:15.802586 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e106fa5f-1c8a-476e-bcba-3d410ed155cc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:15.804208 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e106fa5f-1c8a-476e-bcba-3d410ed155cc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:15.804957 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e106fa5f-1c8a-476e-bcba-3d410ed155cc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:15.805865 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e106fa5f-1c8a-476e-bcba-3d410ed155cc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:15.806518 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e106fa5f-1c8a-476e-bcba-3d410ed155cc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:15.809978 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e106fa5f-1c8a-476e-bcba-3d410ed155cc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:15.861558 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-c84cfe31-3f86-49ef-95e0-23fd8d16ef8a req-8e2dd5e7-b900-4c77-9bad-3c8cb074aad7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2772d7f-d505-44ab-a062-58bd88bd49d3", "tag": "e84e11b7-68e1-423d-a896-f0d3e2146a03"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:48:15.892429 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-c84cfe31-3f86-49ef-95e0-23fd8d16ef8a req-8e2dd5e7-b900-4c77-9bad-3c8cb074aad7 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:15.892911 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-c84cfe31-3f86-49ef-95e0-23fd8d16ef8a req-8e2dd5e7-b900-4c77-9bad-3c8cb074aad7 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:15.893343 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-c84cfe31-3f86-49ef-95e0-23fd8d16ef8a req-8e2dd5e7-b900-4c77-9bad-3c8cb074aad7 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:15.948168 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-c84cfe31-3f86-49ef-95e0-23fd8d16ef8a req-8e2dd5e7-b900-4c77-9bad-3c8cb074aad7 service nova] Creating event network-changed:e84e11b7-68e1-423d-a896-f0d3e2146a03 for instance f2772d7f-d505-44ab-a062-58bd88bd49d3 on hv-cinder-maste Oct 24 08:48:15.949921 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-c84cfe31-3f86-49ef-95e0-23fd8d16ef8a req-8e2dd5e7-b900-4c77-9bad-3c8cb074aad7 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=125164) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 24 08:48:15.950760 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-c84cfe31-3f86-49ef-95e0-23fd8d16ef8a req-8e2dd5e7-b900-4c77-9bad-3c8cb074aad7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=125164) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 24 08:48:15.952668 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a5efff8d-43a7-44b9-be6b-23dd17476d66 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:15.953143 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a5efff8d-43a7-44b9-be6b-23dd17476d66 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:15.958612 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a5efff8d-43a7-44b9-be6b-23dd17476d66 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:15.960887 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a5efff8d-43a7-44b9-be6b-23dd17476d66 None None] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:15.961587 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a5efff8d-43a7-44b9-be6b-23dd17476d66 None None] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:15.963019 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a5efff8d-43a7-44b9-be6b-23dd17476d66 None None] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:15.984452 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.compute.rpcapi [None req-a5efff8d-43a7-44b9-be6b-23dd17476d66 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 24 08:48:15.986395 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a5efff8d-43a7-44b9-be6b-23dd17476d66 None None] Releasing lock "compute-rpcapi-router" {{(pid=125164) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 24 08:48:16.019788 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-a5efff8d-43a7-44b9-be6b-23dd17476d66 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.740875 Oct 24 08:48:16.022036 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 30/56] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:48:16.037514 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-18337377-0f1b-49ed-8612-9b8b22329fca tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:16.038251 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-18337377-0f1b-49ed-8612-9b8b22329fca tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:16.051927 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-18337377-0f1b-49ed-8612-9b8b22329fca tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:16.053333 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-18337377-0f1b-49ed-8612-9b8b22329fca tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:16.055901 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-18337377-0f1b-49ed-8612-9b8b22329fca tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:16.056703 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-18337377-0f1b-49ed-8612-9b8b22329fca tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:16.057043 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-18337377-0f1b-49ed-8612-9b8b22329fca tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:16.057477 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-18337377-0f1b-49ed-8612-9b8b22329fca tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:16.203541 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-e106fa5f-1c8a-476e-bcba-3d410ed155cc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:16.214027 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-e106fa5f-1c8a-476e-bcba-3d410ed155cc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1" status: 200 len: 1368 microversion: 2.1 time: 0.438107 Oct 24 08:48:16.216072 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 27/57] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:15 2022] GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 => generated 1368 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:16.285209 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-18337377-0f1b-49ed-8612-9b8b22329fca tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:16.304162 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-18337377-0f1b-49ed-8612-9b8b22329fca tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1364 microversion: 2.1 time: 0.279843 Oct 24 08:48:16.304404 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-a032cbc3-a333-4616-9f69-c68b26031ea2 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:16.305001 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-a032cbc3-a333-4616-9f69-c68b26031ea2 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:16.306223 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 31/58] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:16 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1364 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:16.311582 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a032cbc3-a333-4616-9f69-c68b26031ea2 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:16.312276 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a032cbc3-a333-4616-9f69-c68b26031ea2 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:16.312896 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a032cbc3-a333-4616-9f69-c68b26031ea2 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:16.313744 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a032cbc3-a333-4616-9f69-c68b26031ea2 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:16.314453 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a032cbc3-a333-4616-9f69-c68b26031ea2 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:16.315043 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a032cbc3-a333-4616-9f69-c68b26031ea2 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:16.384855 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a032cbc3-a333-4616-9f69-c68b26031ea2 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:16.397527 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a032cbc3-a333-4616-9f69-c68b26031ea2 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:16.399469 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a032cbc3-a333-4616-9f69-c68b26031ea2 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:16.400817 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-a032cbc3-a333-4616-9f69-c68b26031ea2 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1333 microversion: 2.20 time: 0.101058 Oct 24 08:48:16.402341 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 28/59] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:48:16 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1333 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:48:16.421020 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-74c3e5a5-92c8-4ba3-b958-dd7cd53b2a84 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:16.422856 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-74c3e5a5-92c8-4ba3-b958-dd7cd53b2a84 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] [instance: 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:16.431128 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-74c3e5a5-92c8-4ba3-b958-dd7cd53b2a84 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:16.432130 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-74c3e5a5-92c8-4ba3-b958-dd7cd53b2a84 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:16.432892 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-74c3e5a5-92c8-4ba3-b958-dd7cd53b2a84 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:16.433879 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-74c3e5a5-92c8-4ba3-b958-dd7cd53b2a84 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:16.434749 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-74c3e5a5-92c8-4ba3-b958-dd7cd53b2a84 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:16.435249 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-74c3e5a5-92c8-4ba3-b958-dd7cd53b2a84 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:16.444302 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell1:SELECT=100 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:48:16.614169 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-74c3e5a5-92c8-4ba3-b958-dd7cd53b2a84 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b002748b80db40358571017d6b42ed09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa4a0e9972c4eb1963334ba4ae99a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:16.626321 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-74c3e5a5-92c8-4ba3-b958-dd7cd53b2a84 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] 10.222.0.26 "GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb" status: 200 len: 1314 microversion: 2.1 time: 0.226392 Oct 24 08:48:16.626925 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 32/60] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:16 2022] GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:48:16.806607 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-4b96b6e2-0233-4080-a6c2-9ca11b8cee31 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:16.807281 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-4b96b6e2-0233-4080-a6c2-9ca11b8cee31 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:16.816126 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4b96b6e2-0233-4080-a6c2-9ca11b8cee31 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:16.816615 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4b96b6e2-0233-4080-a6c2-9ca11b8cee31 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:16.817046 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4b96b6e2-0233-4080-a6c2-9ca11b8cee31 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:16.818132 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4b96b6e2-0233-4080-a6c2-9ca11b8cee31 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:16.818853 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4b96b6e2-0233-4080-a6c2-9ca11b8cee31 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:16.821609 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4b96b6e2-0233-4080-a6c2-9ca11b8cee31 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:16.943022 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-4b96b6e2-0233-4080-a6c2-9ca11b8cee31 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:16.953413 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-4b96b6e2-0233-4080-a6c2-9ca11b8cee31 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1279 microversion: 2.1 time: 0.155798 Oct 24 08:48:16.955123 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 29/61] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:16 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1279 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:17.012820 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-bc0bb5d1-d3da-446e-9b35-dc578af5a9e9 req-49b15e78-6746-42d0-9784-ac2d0f6c9ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6890641-4753-4fb7-86a4-fb5782b1b5b1", "tag": "20f1d856-5c54-4f99-8f43-55b3a29d8726"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:48:17.030737 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-bc0bb5d1-d3da-446e-9b35-dc578af5a9e9 req-49b15e78-6746-42d0-9784-ac2d0f6c9ef1 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:17.032904 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-bc0bb5d1-d3da-446e-9b35-dc578af5a9e9 req-49b15e78-6746-42d0-9784-ac2d0f6c9ef1 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:17.033804 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-bc0bb5d1-d3da-446e-9b35-dc578af5a9e9 req-49b15e78-6746-42d0-9784-ac2d0f6c9ef1 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:17.069432 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-bc0bb5d1-d3da-446e-9b35-dc578af5a9e9 req-49b15e78-6746-42d0-9784-ac2d0f6c9ef1 service nova] Creating event network-changed:20f1d856-5c54-4f99-8f43-55b3a29d8726 for instance f6890641-4753-4fb7-86a4-fb5782b1b5b1 on hv-cinder-maste Oct 24 08:48:17.076380 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-bc0bb5d1-d3da-446e-9b35-dc578af5a9e9 req-49b15e78-6746-42d0-9784-ac2d0f6c9ef1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067339 Oct 24 08:48:17.077633 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 33/62] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:48:17.240974 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-99a86b79-8ad1-4854-b638-430cf04d5535 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:17.240974 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-99a86b79-8ad1-4854-b638-430cf04d5535 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:17.246226 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-99a86b79-8ad1-4854-b638-430cf04d5535 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:17.246899 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-99a86b79-8ad1-4854-b638-430cf04d5535 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:17.247176 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-99a86b79-8ad1-4854-b638-430cf04d5535 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:17.247834 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-99a86b79-8ad1-4854-b638-430cf04d5535 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:17.248444 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-99a86b79-8ad1-4854-b638-430cf04d5535 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:17.249019 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-99a86b79-8ad1-4854-b638-430cf04d5535 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:17.328619 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-12134e93-0c91-4ec0-b7da-cf06e1c92cd8 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:17.329319 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-12134e93-0c91-4ec0-b7da-cf06e1c92cd8 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:17.336269 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-12134e93-0c91-4ec0-b7da-cf06e1c92cd8 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:17.336766 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-12134e93-0c91-4ec0-b7da-cf06e1c92cd8 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:17.337207 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-12134e93-0c91-4ec0-b7da-cf06e1c92cd8 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:17.337904 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-12134e93-0c91-4ec0-b7da-cf06e1c92cd8 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:17.338360 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-12134e93-0c91-4ec0-b7da-cf06e1c92cd8 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:17.338811 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-12134e93-0c91-4ec0-b7da-cf06e1c92cd8 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:17.413973 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-99a86b79-8ad1-4854-b638-430cf04d5535 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:17.427353 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-99a86b79-8ad1-4854-b638-430cf04d5535 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1" status: 200 len: 1368 microversion: 2.1 time: 0.191594 Oct 24 08:48:17.428237 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 30/63] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:17 2022] GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 => generated 1368 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:17.433442 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-d74821d4-c704-44e7-ab62-503b2bb479ad tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:17.434216 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-d74821d4-c704-44e7-ab62-503b2bb479ad tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:17.441181 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d74821d4-c704-44e7-ab62-503b2bb479ad tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:17.441876 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d74821d4-c704-44e7-ab62-503b2bb479ad tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:17.442839 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d74821d4-c704-44e7-ab62-503b2bb479ad tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:17.444335 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d74821d4-c704-44e7-ab62-503b2bb479ad tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:17.445801 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d74821d4-c704-44e7-ab62-503b2bb479ad tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:17.447688 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d74821d4-c704-44e7-ab62-503b2bb479ad tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:17.532974 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-12134e93-0c91-4ec0-b7da-cf06e1c92cd8 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:17.546012 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-d74821d4-c704-44e7-ab62-503b2bb479ad tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:17.548997 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-12134e93-0c91-4ec0-b7da-cf06e1c92cd8 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1364 microversion: 2.1 time: 0.224384 Oct 24 08:48:17.550777 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 34/64] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:17 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:48:17.556825 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-d74821d4-c704-44e7-ab62-503b2bb479ad tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:17.558655 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-d74821d4-c704-44e7-ab62-503b2bb479ad tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:17.559928 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-d74821d4-c704-44e7-ab62-503b2bb479ad tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1333 microversion: 2.20 time: 0.130399 Oct 24 08:48:17.560895 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 31/65] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:48:17 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1333 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:48:17.651321 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-d65a80d7-407a-4a07-9b12-f9158274bcd6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:17.651960 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-d65a80d7-407a-4a07-9b12-f9158274bcd6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] [instance: 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:17.658989 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d65a80d7-407a-4a07-9b12-f9158274bcd6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:17.659534 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d65a80d7-407a-4a07-9b12-f9158274bcd6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:17.659926 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d65a80d7-407a-4a07-9b12-f9158274bcd6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:17.660790 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d65a80d7-407a-4a07-9b12-f9158274bcd6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:17.661419 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d65a80d7-407a-4a07-9b12-f9158274bcd6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:17.661853 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d65a80d7-407a-4a07-9b12-f9158274bcd6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:17.801798 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-d65a80d7-407a-4a07-9b12-f9158274bcd6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b002748b80db40358571017d6b42ed09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa4a0e9972c4eb1963334ba4ae99a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:17.809554 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-d65a80d7-407a-4a07-9b12-f9158274bcd6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] 10.222.0.26 "GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb" status: 200 len: 1314 microversion: 2.1 time: 0.163199 Oct 24 08:48:17.810316 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 35/66] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:17 2022] GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:17.976856 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-75b53486-bc59-4b45-a18a-65e3de56ab50 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:17.977780 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-75b53486-bc59-4b45-a18a-65e3de56ab50 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:17.985479 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-75b53486-bc59-4b45-a18a-65e3de56ab50 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:17.986173 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-75b53486-bc59-4b45-a18a-65e3de56ab50 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:17.986792 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-75b53486-bc59-4b45-a18a-65e3de56ab50 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:17.987696 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-75b53486-bc59-4b45-a18a-65e3de56ab50 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:17.988287 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-75b53486-bc59-4b45-a18a-65e3de56ab50 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:17.988863 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-75b53486-bc59-4b45-a18a-65e3de56ab50 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:18.060483 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-75b53486-bc59-4b45-a18a-65e3de56ab50 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:18.071974 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-75b53486-bc59-4b45-a18a-65e3de56ab50 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1279 microversion: 2.1 time: 0.099644 Oct 24 08:48:18.072927 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 32/67] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:17 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1279 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:18.452519 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-65c0de7f-a7b2-4b06-adbc-915e2e41c7d7 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:18.454211 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-65c0de7f-a7b2-4b06-adbc-915e2e41c7d7 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:18.467734 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-65c0de7f-a7b2-4b06-adbc-915e2e41c7d7 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:18.468309 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-65c0de7f-a7b2-4b06-adbc-915e2e41c7d7 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:18.469517 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-65c0de7f-a7b2-4b06-adbc-915e2e41c7d7 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:18.473416 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-65c0de7f-a7b2-4b06-adbc-915e2e41c7d7 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:18.476430 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-65c0de7f-a7b2-4b06-adbc-915e2e41c7d7 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:18.477083 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-65c0de7f-a7b2-4b06-adbc-915e2e41c7d7 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:18.576935 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-0cf5da9d-7b00-4ad0-99f7-281190ca323e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:18.577532 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-0cf5da9d-7b00-4ad0-99f7-281190ca323e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:18.600106 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0cf5da9d-7b00-4ad0-99f7-281190ca323e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:18.600613 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0cf5da9d-7b00-4ad0-99f7-281190ca323e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:18.601048 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0cf5da9d-7b00-4ad0-99f7-281190ca323e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:18.601760 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0cf5da9d-7b00-4ad0-99f7-281190ca323e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:18.602210 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0cf5da9d-7b00-4ad0-99f7-281190ca323e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:18.602633 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0cf5da9d-7b00-4ad0-99f7-281190ca323e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:19.112498 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-0cf5da9d-7b00-4ad0-99f7-281190ca323e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:19.127584 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-0cf5da9d-7b00-4ad0-99f7-281190ca323e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1364 microversion: 2.1 time: 0.555990 Oct 24 08:48:19.128640 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 33/68] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:18 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1364 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:48:19.144477 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-65c0de7f-a7b2-4b06-adbc-915e2e41c7d7 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:19.144477 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-65c0de7f-a7b2-4b06-adbc-915e2e41c7d7 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1" status: 200 len: 1368 microversion: 2.1 time: 0.695396 Oct 24 08:48:19.144477 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 36/69] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:18 2022] GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 => generated 1368 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:19.149506 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-1e56e813-d806-4f86-8da5-1c771a2fde37 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:19.150156 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-1e56e813-d806-4f86-8da5-1c771a2fde37 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:19.151145 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-ac8c25b7-b8ed-459c-a2ee-932783516353 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:19.151960 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-ac8c25b7-b8ed-459c-a2ee-932783516353 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] [instance: 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:19.161621 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ac8c25b7-b8ed-459c-a2ee-932783516353 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:19.162487 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ac8c25b7-b8ed-459c-a2ee-932783516353 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:19.164785 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ac8c25b7-b8ed-459c-a2ee-932783516353 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:19.166086 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ac8c25b7-b8ed-459c-a2ee-932783516353 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:19.166547 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ac8c25b7-b8ed-459c-a2ee-932783516353 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:19.168506 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:48:19.169008 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ac8c25b7-b8ed-459c-a2ee-932783516353 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:19.171421 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1e56e813-d806-4f86-8da5-1c771a2fde37 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:19.172198 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1e56e813-d806-4f86-8da5-1c771a2fde37 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:19.172828 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1e56e813-d806-4f86-8da5-1c771a2fde37 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:19.173773 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1e56e813-d806-4f86-8da5-1c771a2fde37 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:19.182096 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1e56e813-d806-4f86-8da5-1c771a2fde37 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:19.185262 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1e56e813-d806-4f86-8da5-1c771a2fde37 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:19.339306 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-1e56e813-d806-4f86-8da5-1c771a2fde37 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:19.350351 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-1e56e813-d806-4f86-8da5-1c771a2fde37 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:19.352182 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-1e56e813-d806-4f86-8da5-1c771a2fde37 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:19.353589 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-1e56e813-d806-4f86-8da5-1c771a2fde37 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1333 microversion: 2.20 time: 0.208221 Oct 24 08:48:19.371158 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 37/70] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:48:19 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1333 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:48:19.376408 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-39669b36-da12-4c9c-bd61-d43596d6a977 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:19.377508 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-39669b36-da12-4c9c-bd61-d43596d6a977 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:19.385837 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-39669b36-da12-4c9c-bd61-d43596d6a977 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:19.387614 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-39669b36-da12-4c9c-bd61-d43596d6a977 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:19.388290 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-39669b36-da12-4c9c-bd61-d43596d6a977 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:19.389318 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-39669b36-da12-4c9c-bd61-d43596d6a977 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:19.390062 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-39669b36-da12-4c9c-bd61-d43596d6a977 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:19.390777 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-39669b36-da12-4c9c-bd61-d43596d6a977 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:19.575555 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-39669b36-da12-4c9c-bd61-d43596d6a977 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:19.593670 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-39669b36-da12-4c9c-bd61-d43596d6a977 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1279 microversion: 2.1 time: 0.221108 Oct 24 08:48:19.608090 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-ac8c25b7-b8ed-459c-a2ee-932783516353 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b002748b80db40358571017d6b42ed09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa4a0e9972c4eb1963334ba4ae99a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:19.609093 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 38/71] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:19 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1279 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:19.618284 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-ac8c25b7-b8ed-459c-a2ee-932783516353 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] 10.222.0.26 "GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb" status: 200 len: 1314 microversion: 2.1 time: 0.471657 Oct 24 08:48:19.622929 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 34/72] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:19 2022] GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb => generated 1314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:20.155675 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-a7197023-c0ca-4c60-b13e-432600841989 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:20.156631 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-a7197023-c0ca-4c60-b13e-432600841989 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:20.168256 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-4f74d531-0a11-4bea-96ab-22808f03316b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:20.168715 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-4f74d531-0a11-4bea-96ab-22808f03316b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:20.171796 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a7197023-c0ca-4c60-b13e-432600841989 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:20.172544 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a7197023-c0ca-4c60-b13e-432600841989 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:20.173439 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a7197023-c0ca-4c60-b13e-432600841989 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:20.174295 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a7197023-c0ca-4c60-b13e-432600841989 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:20.175052 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a7197023-c0ca-4c60-b13e-432600841989 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:20.175633 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a7197023-c0ca-4c60-b13e-432600841989 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:20.184676 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4f74d531-0a11-4bea-96ab-22808f03316b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:20.185461 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4f74d531-0a11-4bea-96ab-22808f03316b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:20.186073 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4f74d531-0a11-4bea-96ab-22808f03316b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:20.187581 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4f74d531-0a11-4bea-96ab-22808f03316b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:20.188195 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4f74d531-0a11-4bea-96ab-22808f03316b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:20.188780 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4f74d531-0a11-4bea-96ab-22808f03316b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:20.524259 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-a7197023-c0ca-4c60-b13e-432600841989 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:20.532327 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-a7197023-c0ca-4c60-b13e-432600841989 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1364 microversion: 2.1 time: 0.383680 Oct 24 08:48:20.548320 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 39/73] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:20 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1364 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:20.555931 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-f5e1b223-29ab-40bb-b5cd-cba090b911e4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:20.556877 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-f5e1b223-29ab-40bb-b5cd-cba090b911e4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:20.564551 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f5e1b223-29ab-40bb-b5cd-cba090b911e4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:20.565299 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f5e1b223-29ab-40bb-b5cd-cba090b911e4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:20.566046 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f5e1b223-29ab-40bb-b5cd-cba090b911e4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:20.567029 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f5e1b223-29ab-40bb-b5cd-cba090b911e4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:20.567686 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f5e1b223-29ab-40bb-b5cd-cba090b911e4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:20.568361 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f5e1b223-29ab-40bb-b5cd-cba090b911e4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:20.647319 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-4f74d531-0a11-4bea-96ab-22808f03316b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:20.656135 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-4f74d531-0a11-4bea-96ab-22808f03316b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1" status: 200 len: 1368 microversion: 2.1 time: 0.492643 Oct 24 08:48:20.675374 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 35/74] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:20 2022] GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 => generated 1368 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:20.678957 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-f5e1b223-29ab-40bb-b5cd-cba090b911e4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:20.688487 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-4ecbb763-e56c-4e85-ae79-567cbcc6d08b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:20.689145 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-4ecbb763-e56c-4e85-ae79-567cbcc6d08b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:20.703887 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-f5e1b223-29ab-40bb-b5cd-cba090b911e4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:20.704766 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4ecbb763-e56c-4e85-ae79-567cbcc6d08b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:20.704766 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4ecbb763-e56c-4e85-ae79-567cbcc6d08b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:20.706674 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-f5e1b223-29ab-40bb-b5cd-cba090b911e4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:20.710948 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-f5e1b223-29ab-40bb-b5cd-cba090b911e4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1339 microversion: 2.20 time: 0.159040 Oct 24 08:48:20.719634 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 40/75] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:48:20 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1339 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:48:20.725412 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-4f16c5ce-a8f0-4016-beb8-163895732811 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:20.726419 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-4f16c5ce-a8f0-4016-beb8-163895732811 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] [instance: 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:20.726546 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4ecbb763-e56c-4e85-ae79-567cbcc6d08b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:20.729094 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4ecbb763-e56c-4e85-ae79-567cbcc6d08b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:20.729583 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4ecbb763-e56c-4e85-ae79-567cbcc6d08b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:20.730013 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4ecbb763-e56c-4e85-ae79-567cbcc6d08b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:20.733809 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4f16c5ce-a8f0-4016-beb8-163895732811 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:20.735101 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4f16c5ce-a8f0-4016-beb8-163895732811 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:20.736320 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4f16c5ce-a8f0-4016-beb8-163895732811 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:20.737313 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4f16c5ce-a8f0-4016-beb8-163895732811 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:20.737953 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4f16c5ce-a8f0-4016-beb8-163895732811 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:20.738520 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4f16c5ce-a8f0-4016-beb8-163895732811 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:21.139350 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-4f16c5ce-a8f0-4016-beb8-163895732811 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b002748b80db40358571017d6b42ed09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa4a0e9972c4eb1963334ba4ae99a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:21.146841 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-4f16c5ce-a8f0-4016-beb8-163895732811 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] 10.222.0.26 "GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb" status: 200 len: 1314 microversion: 2.1 time: 0.425813 Oct 24 08:48:21.147592 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 41/76] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:20 2022] GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb => generated 1314 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:21.160056 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-4ecbb763-e56c-4e85-ae79-567cbcc6d08b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:21.169359 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-4ecbb763-e56c-4e85-ae79-567cbcc6d08b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1321 microversion: 2.1 time: 0.492774 Oct 24 08:48:21.170067 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 36/77] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:20 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1321 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:21.562074 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-6bd79b2c-adeb-449c-9141-207a551d5bcd tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:21.562949 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-6bd79b2c-adeb-449c-9141-207a551d5bcd tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:21.571834 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6bd79b2c-adeb-449c-9141-207a551d5bcd tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:21.572318 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6bd79b2c-adeb-449c-9141-207a551d5bcd tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:21.572744 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6bd79b2c-adeb-449c-9141-207a551d5bcd tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:21.573642 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6bd79b2c-adeb-449c-9141-207a551d5bcd tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:21.574081 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6bd79b2c-adeb-449c-9141-207a551d5bcd tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:21.574495 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6bd79b2c-adeb-449c-9141-207a551d5bcd tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:21.681617 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-7a5471f9-0c95-4975-b539-00fa5406818b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:21.682268 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-7a5471f9-0c95-4975-b539-00fa5406818b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:21.688739 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7a5471f9-0c95-4975-b539-00fa5406818b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:21.689219 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7a5471f9-0c95-4975-b539-00fa5406818b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:21.689833 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7a5471f9-0c95-4975-b539-00fa5406818b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:21.690614 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7a5471f9-0c95-4975-b539-00fa5406818b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:21.691098 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7a5471f9-0c95-4975-b539-00fa5406818b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:21.691522 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7a5471f9-0c95-4975-b539-00fa5406818b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:21.714293 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-6bd79b2c-adeb-449c-9141-207a551d5bcd tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:21.723449 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-6bd79b2c-adeb-449c-9141-207a551d5bcd tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1364 microversion: 2.1 time: 0.167512 Oct 24 08:48:21.735237 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 42/78] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:21 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:21.749854 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-278c093f-c503-4768-b6a7-1ca7d64185fa tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:21.750561 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-278c093f-c503-4768-b6a7-1ca7d64185fa tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:21.756724 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-278c093f-c503-4768-b6a7-1ca7d64185fa tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:21.757674 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-278c093f-c503-4768-b6a7-1ca7d64185fa tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:21.758291 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-278c093f-c503-4768-b6a7-1ca7d64185fa tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:21.759187 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-278c093f-c503-4768-b6a7-1ca7d64185fa tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:21.759814 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-278c093f-c503-4768-b6a7-1ca7d64185fa tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:21.760936 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-278c093f-c503-4768-b6a7-1ca7d64185fa tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:21.869639 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-278c093f-c503-4768-b6a7-1ca7d64185fa tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:21.879924 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-278c093f-c503-4768-b6a7-1ca7d64185fa tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:21.881553 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-278c093f-c503-4768-b6a7-1ca7d64185fa tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:21.882697 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-278c093f-c503-4768-b6a7-1ca7d64185fa tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1339 microversion: 2.20 time: 0.146320 Oct 24 08:48:21.885775 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-7a5471f9-0c95-4975-b539-00fa5406818b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:21.892897 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 43/79] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:48:21 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1339 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:48:21.897914 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-7a5471f9-0c95-4975-b539-00fa5406818b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1" status: 200 len: 1368 microversion: 2.1 time: 0.220033 Oct 24 08:48:21.907352 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 37/80] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:21 2022] GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 => generated 1368 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:22.173413 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-3f49bb64-16c3-4151-b49d-92e490deb310 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:22.178045 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-3f49bb64-16c3-4151-b49d-92e490deb310 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] [instance: 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:22.187809 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3f49bb64-16c3-4151-b49d-92e490deb310 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:22.188372 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3f49bb64-16c3-4151-b49d-92e490deb310 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:22.188847 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3f49bb64-16c3-4151-b49d-92e490deb310 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:22.189540 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3f49bb64-16c3-4151-b49d-92e490deb310 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:22.190016 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3f49bb64-16c3-4151-b49d-92e490deb310 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:22.190425 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3f49bb64-16c3-4151-b49d-92e490deb310 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:22.191873 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-0f6d018a-cc9a-4dc5-a8f1-166125d363fd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:22.192627 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-0f6d018a-cc9a-4dc5-a8f1-166125d363fd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:22.201274 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0f6d018a-cc9a-4dc5-a8f1-166125d363fd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:22.201786 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0f6d018a-cc9a-4dc5-a8f1-166125d363fd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:22.202233 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0f6d018a-cc9a-4dc5-a8f1-166125d363fd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:22.205500 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0f6d018a-cc9a-4dc5-a8f1-166125d363fd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:22.206098 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0f6d018a-cc9a-4dc5-a8f1-166125d363fd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:22.206582 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0f6d018a-cc9a-4dc5-a8f1-166125d363fd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:22.593897 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-3f49bb64-16c3-4151-b49d-92e490deb310 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b002748b80db40358571017d6b42ed09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa4a0e9972c4eb1963334ba4ae99a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:22.611357 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-3f49bb64-16c3-4151-b49d-92e490deb310 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] 10.222.0.26 "GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb" status: 200 len: 1314 microversion: 2.1 time: 0.443315 Oct 24 08:48:22.622935 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 44/81] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:22 2022] GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb => generated 1314 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:22.631098 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-0f6d018a-cc9a-4dc5-a8f1-166125d363fd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:22.640387 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-0f6d018a-cc9a-4dc5-a8f1-166125d363fd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1321 microversion: 2.1 time: 0.452284 Oct 24 08:48:22.645396 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 38/82] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:22 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1321 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:22.753316 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-ff828360-607a-4a1a-9b51-854b77e52c9e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:22.755551 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-ff828360-607a-4a1a-9b51-854b77e52c9e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:22.766144 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ff828360-607a-4a1a-9b51-854b77e52c9e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:22.766660 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ff828360-607a-4a1a-9b51-854b77e52c9e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:22.770338 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ff828360-607a-4a1a-9b51-854b77e52c9e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:22.781419 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ff828360-607a-4a1a-9b51-854b77e52c9e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:22.781919 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ff828360-607a-4a1a-9b51-854b77e52c9e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:22.782351 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ff828360-607a-4a1a-9b51-854b77e52c9e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:22.920420 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-b98baf2a-faca-4917-8372-09e630d49a80 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:22.921300 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-b98baf2a-faca-4917-8372-09e630d49a80 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:22.930675 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b98baf2a-faca-4917-8372-09e630d49a80 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:22.933177 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b98baf2a-faca-4917-8372-09e630d49a80 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:22.933790 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b98baf2a-faca-4917-8372-09e630d49a80 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:22.934645 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b98baf2a-faca-4917-8372-09e630d49a80 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:22.939063 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b98baf2a-faca-4917-8372-09e630d49a80 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:22.939707 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b98baf2a-faca-4917-8372-09e630d49a80 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:23.139876 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-b98baf2a-faca-4917-8372-09e630d49a80 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:23.150482 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-b98baf2a-faca-4917-8372-09e630d49a80 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:23.152236 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-b98baf2a-faca-4917-8372-09e630d49a80 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:23.154539 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-b98baf2a-faca-4917-8372-09e630d49a80 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1339 microversion: 2.20 time: 0.238064 Oct 24 08:48:23.155347 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 39/83] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:48:22 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1339 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:48:23.171147 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-1d0153dd-dfeb-4e0f-b7d6-a67a44aa1471 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:23.172158 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-1d0153dd-dfeb-4e0f-b7d6-a67a44aa1471 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:23.180493 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1d0153dd-dfeb-4e0f-b7d6-a67a44aa1471 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:23.181122 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1d0153dd-dfeb-4e0f-b7d6-a67a44aa1471 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:23.181745 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1d0153dd-dfeb-4e0f-b7d6-a67a44aa1471 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:23.182664 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1d0153dd-dfeb-4e0f-b7d6-a67a44aa1471 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:23.183339 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1d0153dd-dfeb-4e0f-b7d6-a67a44aa1471 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:23.185471 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1d0153dd-dfeb-4e0f-b7d6-a67a44aa1471 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:23.276072 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-ff828360-607a-4a1a-9b51-854b77e52c9e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:23.288518 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-ff828360-607a-4a1a-9b51-854b77e52c9e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1364 microversion: 2.1 time: 0.539768 Oct 24 08:48:23.293813 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 45/84] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:22 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1364 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:23.461829 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell0:SELECT=10 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:48:23.486064 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-1d0153dd-dfeb-4e0f-b7d6-a67a44aa1471 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:23.495706 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-1d0153dd-dfeb-4e0f-b7d6-a67a44aa1471 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1" status: 200 len: 1368 microversion: 2.1 time: 0.338459 Oct 24 08:48:23.498536 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 40/85] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:23 2022] GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 => generated 1368 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:23.611423 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-7819dfca-f3b7-4435-a8a5-4631d30949da req-74bf1fb2-15a8-4840-ad6a-fe6047394275 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "031a03be-3f3b-46dd-944c-6e68a9d8b09a", "name": "network-vif-plugged", "status": "completed", "tag": "634028ec-acae-487c-82c9-606115b581ba"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:48:23.637796 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-71cc6d39-9f15-4beb-aa7c-475b4abf132a tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:23.638593 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-71cc6d39-9f15-4beb-aa7c-475b4abf132a tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] [instance: 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:23.640914 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell0:SELECT=32 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:48:23.645619 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-7819dfca-f3b7-4435-a8a5-4631d30949da req-74bf1fb2-15a8-4840-ad6a-fe6047394275 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:23.648520 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-7819dfca-f3b7-4435-a8a5-4631d30949da req-74bf1fb2-15a8-4840-ad6a-fe6047394275 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:23.649534 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-7819dfca-f3b7-4435-a8a5-4631d30949da req-74bf1fb2-15a8-4840-ad6a-fe6047394275 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:23.656412 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-71cc6d39-9f15-4beb-aa7c-475b4abf132a tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:23.657218 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-71cc6d39-9f15-4beb-aa7c-475b4abf132a tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:23.657812 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-71cc6d39-9f15-4beb-aa7c-475b4abf132a tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:23.659458 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-71cc6d39-9f15-4beb-aa7c-475b4abf132a tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:23.660049 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-71cc6d39-9f15-4beb-aa7c-475b4abf132a tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:23.661104 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-71cc6d39-9f15-4beb-aa7c-475b4abf132a tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:23.674929 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell1:SELECT=100 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:48:23.692653 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-7819dfca-f3b7-4435-a8a5-4631d30949da req-74bf1fb2-15a8-4840-ad6a-fe6047394275 service nova] Creating event network-vif-plugged:634028ec-acae-487c-82c9-606115b581ba for instance 031a03be-3f3b-46dd-944c-6e68a9d8b09a on hv-cinder-maste Oct 24 08:48:23.698802 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-7819dfca-f3b7-4435-a8a5-4631d30949da req-74bf1fb2-15a8-4840-ad6a-fe6047394275 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.401631 Oct 24 08:48:23.700189 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 46/86] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:48:23.708172 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-e248192b-ec30-4dce-b87f-c5bc67851ed0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:23.709267 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-e248192b-ec30-4dce-b87f-c5bc67851ed0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:23.725357 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e248192b-ec30-4dce-b87f-c5bc67851ed0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:23.725922 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e248192b-ec30-4dce-b87f-c5bc67851ed0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:23.726381 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e248192b-ec30-4dce-b87f-c5bc67851ed0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:23.727143 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e248192b-ec30-4dce-b87f-c5bc67851ed0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:23.727605 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e248192b-ec30-4dce-b87f-c5bc67851ed0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:23.728030 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e248192b-ec30-4dce-b87f-c5bc67851ed0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:24.031957 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-71cc6d39-9f15-4beb-aa7c-475b4abf132a tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b002748b80db40358571017d6b42ed09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa4a0e9972c4eb1963334ba4ae99a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:24.042285 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-71cc6d39-9f15-4beb-aa7c-475b4abf132a tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] 10.222.0.26 "GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb" status: 200 len: 1314 microversion: 2.1 time: 0.408476 Oct 24 08:48:24.043211 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 41/87] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:23 2022] GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:24.044375 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell0:SELECT=22 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:48:24.047773 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-e248192b-ec30-4dce-b87f-c5bc67851ed0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:24.057705 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-e248192b-ec30-4dce-b87f-c5bc67851ed0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1321 microversion: 2.1 time: 0.355997 Oct 24 08:48:24.063364 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 47/88] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:23 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1321 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:24.183098 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-197443ff-4ee8-47c3-a98e-3c2b7ad8ffde tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:24.183993 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-197443ff-4ee8-47c3-a98e-3c2b7ad8ffde tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:24.192478 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-197443ff-4ee8-47c3-a98e-3c2b7ad8ffde tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:24.193058 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-197443ff-4ee8-47c3-a98e-3c2b7ad8ffde tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:24.193583 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-197443ff-4ee8-47c3-a98e-3c2b7ad8ffde tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:24.194456 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-197443ff-4ee8-47c3-a98e-3c2b7ad8ffde tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:24.195000 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-197443ff-4ee8-47c3-a98e-3c2b7ad8ffde tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:24.195890 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-197443ff-4ee8-47c3-a98e-3c2b7ad8ffde tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:24.263918 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-465dc695-2271-4878-a22c-059c2822b095 req-e9512b8c-e559-4e29-a7b6-352de3026609 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca02e6b0-1ae6-407d-b554-7f96d1aa1726", "tag": "251f4f85-a3d9-4ade-80a5-bbb88e814476"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:48:24.280557 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-465dc695-2271-4878-a22c-059c2822b095 req-e9512b8c-e559-4e29-a7b6-352de3026609 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:24.285246 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-465dc695-2271-4878-a22c-059c2822b095 req-e9512b8c-e559-4e29-a7b6-352de3026609 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:24.286090 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-465dc695-2271-4878-a22c-059c2822b095 req-e9512b8c-e559-4e29-a7b6-352de3026609 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:24.312364 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-465dc695-2271-4878-a22c-059c2822b095 req-e9512b8c-e559-4e29-a7b6-352de3026609 service nova] Creating event network-changed:251f4f85-a3d9-4ade-80a5-bbb88e814476 for instance ca02e6b0-1ae6-407d-b554-7f96d1aa1726 on hv-cinder-maste Oct 24 08:48:24.332135 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-465dc695-2271-4878-a22c-059c2822b095 req-e9512b8c-e559-4e29-a7b6-352de3026609 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072169 Oct 24 08:48:24.335812 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 48/89] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:48:24.352642 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-760e804c-0f82-46cf-8fa3-878239ccb446 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:24.353345 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-760e804c-0f82-46cf-8fa3-878239ccb446 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:24.368709 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-760e804c-0f82-46cf-8fa3-878239ccb446 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:24.369217 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-760e804c-0f82-46cf-8fa3-878239ccb446 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:24.369716 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-760e804c-0f82-46cf-8fa3-878239ccb446 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:24.370488 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-760e804c-0f82-46cf-8fa3-878239ccb446 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:24.371034 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-760e804c-0f82-46cf-8fa3-878239ccb446 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:24.371889 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-760e804c-0f82-46cf-8fa3-878239ccb446 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:24.413381 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-197443ff-4ee8-47c3-a98e-3c2b7ad8ffde tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:24.425430 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-197443ff-4ee8-47c3-a98e-3c2b7ad8ffde tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:24.427667 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-197443ff-4ee8-47c3-a98e-3c2b7ad8ffde tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:24.429626 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-197443ff-4ee8-47c3-a98e-3c2b7ad8ffde tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1406 microversion: 2.20 time: 0.251209 Oct 24 08:48:24.430788 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 42/90] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:48:24 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1406 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:48:24.521947 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-b6135ad2-b3b4-4196-91aa-e10a0e5ff794 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:24.522640 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-b6135ad2-b3b4-4196-91aa-e10a0e5ff794 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:24.531321 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b6135ad2-b3b4-4196-91aa-e10a0e5ff794 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:24.531634 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b6135ad2-b3b4-4196-91aa-e10a0e5ff794 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:24.533488 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b6135ad2-b3b4-4196-91aa-e10a0e5ff794 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:24.537968 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b6135ad2-b3b4-4196-91aa-e10a0e5ff794 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:24.538523 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b6135ad2-b3b4-4196-91aa-e10a0e5ff794 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:24.540686 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b6135ad2-b3b4-4196-91aa-e10a0e5ff794 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:24.573960 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-760e804c-0f82-46cf-8fa3-878239ccb446 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:24.589798 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-760e804c-0f82-46cf-8fa3-878239ccb446 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1364 microversion: 2.1 time: 0.249106 Oct 24 08:48:24.592094 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 49/91] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:24 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1364 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:24.739720 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-b6135ad2-b3b4-4196-91aa-e10a0e5ff794 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:24.747906 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-b6135ad2-b3b4-4196-91aa-e10a0e5ff794 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1" status: 200 len: 1368 microversion: 2.1 time: 0.231381 Oct 24 08:48:24.748526 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 43/92] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:24 2022] GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 => generated 1368 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:25.076349 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-5d583d22-4cf4-42ec-af4b-4c40d681c186 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:25.079937 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-51710e5b-104e-40a8-845e-c082ce0b3a33 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:25.080955 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-51710e5b-104e-40a8-845e-c082ce0b3a33 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:25.081803 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-5d583d22-4cf4-42ec-af4b-4c40d681c186 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] [instance: 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:25.093192 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-51710e5b-104e-40a8-845e-c082ce0b3a33 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:25.095012 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-51710e5b-104e-40a8-845e-c082ce0b3a33 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:25.095480 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5d583d22-4cf4-42ec-af4b-4c40d681c186 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:25.096076 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-51710e5b-104e-40a8-845e-c082ce0b3a33 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:25.096376 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5d583d22-4cf4-42ec-af4b-4c40d681c186 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:25.096846 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-51710e5b-104e-40a8-845e-c082ce0b3a33 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:25.097238 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5d583d22-4cf4-42ec-af4b-4c40d681c186 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:25.097347 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-51710e5b-104e-40a8-845e-c082ce0b3a33 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:25.097704 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-51710e5b-104e-40a8-845e-c082ce0b3a33 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:25.109877 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5d583d22-4cf4-42ec-af4b-4c40d681c186 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:25.114766 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5d583d22-4cf4-42ec-af4b-4c40d681c186 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:25.114766 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5d583d22-4cf4-42ec-af4b-4c40d681c186 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:25.442896 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-51710e5b-104e-40a8-845e-c082ce0b3a33 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:25.457015 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-51710e5b-104e-40a8-845e-c082ce0b3a33 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1321 microversion: 2.1 time: 0.381032 Oct 24 08:48:25.476518 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 44/93] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:25 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1321 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:25.483146 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-d116d171-b455-4af8-89b9-829305a05238 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:25.484099 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-d116d171-b455-4af8-89b9-829305a05238 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:25.497942 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d116d171-b455-4af8-89b9-829305a05238 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:25.499500 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d116d171-b455-4af8-89b9-829305a05238 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:25.500834 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d116d171-b455-4af8-89b9-829305a05238 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:25.514835 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d116d171-b455-4af8-89b9-829305a05238 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:25.524681 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d116d171-b455-4af8-89b9-829305a05238 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:25.526546 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d116d171-b455-4af8-89b9-829305a05238 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:25.542483 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-5d583d22-4cf4-42ec-af4b-4c40d681c186 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b002748b80db40358571017d6b42ed09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa4a0e9972c4eb1963334ba4ae99a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:25.546834 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell1:SELECT=100 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:48:25.557341 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-5d583d22-4cf4-42ec-af4b-4c40d681c186 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] 10.222.0.26 "GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb" status: 200 len: 1314 microversion: 2.1 time: 0.495343 Oct 24 08:48:25.560814 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 50/94] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:25 2022] GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb => generated 1314 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:25.618865 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-80dc331f-8fa5-4bd1-a03c-7237cf2c5e83 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:25.619787 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-80dc331f-8fa5-4bd1-a03c-7237cf2c5e83 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:25.628191 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-80dc331f-8fa5-4bd1-a03c-7237cf2c5e83 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:25.629163 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-80dc331f-8fa5-4bd1-a03c-7237cf2c5e83 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:25.629787 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-80dc331f-8fa5-4bd1-a03c-7237cf2c5e83 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:25.630882 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-80dc331f-8fa5-4bd1-a03c-7237cf2c5e83 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:25.631487 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-80dc331f-8fa5-4bd1-a03c-7237cf2c5e83 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:25.632338 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-80dc331f-8fa5-4bd1-a03c-7237cf2c5e83 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:25.981447 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell0:SELECT=6 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:48:26.213195 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-d116d171-b455-4af8-89b9-829305a05238 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:26.222519 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-d116d171-b455-4af8-89b9-829305a05238 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:26.223892 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-d116d171-b455-4af8-89b9-829305a05238 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:26.225003 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-d116d171-b455-4af8-89b9-829305a05238 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1406 microversion: 2.20 time: 0.747005 Oct 24 08:48:26.231389 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-80dc331f-8fa5-4bd1-a03c-7237cf2c5e83 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:26.240691 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 45/95] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:48:25 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1406 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:48:26.241021 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-80dc331f-8fa5-4bd1-a03c-7237cf2c5e83 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1364 microversion: 2.1 time: 0.629591 Oct 24 08:48:26.242755 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 51/96] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:25 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1364 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:48:26.251063 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-f6faa291-5bfb-4922-8039-375334b2d317 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:26.252278 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-f6faa291-5bfb-4922-8039-375334b2d317 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:26.261246 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f6faa291-5bfb-4922-8039-375334b2d317 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:26.261770 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f6faa291-5bfb-4922-8039-375334b2d317 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:26.262210 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f6faa291-5bfb-4922-8039-375334b2d317 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:26.262950 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f6faa291-5bfb-4922-8039-375334b2d317 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:26.263420 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f6faa291-5bfb-4922-8039-375334b2d317 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:26.263873 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f6faa291-5bfb-4922-8039-375334b2d317 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:26.425546 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-f6faa291-5bfb-4922-8039-375334b2d317 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:26.439822 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-f6faa291-5bfb-4922-8039-375334b2d317 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1" status: 200 len: 1368 microversion: 2.1 time: 0.197763 Oct 24 08:48:26.441830 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 46/97] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:26 2022] GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 => generated 1368 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:26.483320 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-f396abf1-5784-4e81-96c4-34e2463d8b83 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:26.483935 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-f396abf1-5784-4e81-96c4-34e2463d8b83 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:26.490599 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f396abf1-5784-4e81-96c4-34e2463d8b83 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:26.491345 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f396abf1-5784-4e81-96c4-34e2463d8b83 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:26.491950 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f396abf1-5784-4e81-96c4-34e2463d8b83 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:26.492698 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f396abf1-5784-4e81-96c4-34e2463d8b83 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:26.493315 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f396abf1-5784-4e81-96c4-34e2463d8b83 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:26.493951 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f396abf1-5784-4e81-96c4-34e2463d8b83 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:26.589997 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-18adc910-50c6-456e-8a75-850b21cacb81 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:26.591977 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-18adc910-50c6-456e-8a75-850b21cacb81 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] [instance: 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:26.625051 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-18adc910-50c6-456e-8a75-850b21cacb81 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:26.625725 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-18adc910-50c6-456e-8a75-850b21cacb81 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:26.626172 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-18adc910-50c6-456e-8a75-850b21cacb81 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:26.627197 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-18adc910-50c6-456e-8a75-850b21cacb81 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:26.628591 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-18adc910-50c6-456e-8a75-850b21cacb81 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:26.629412 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-18adc910-50c6-456e-8a75-850b21cacb81 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:26.690241 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-f396abf1-5784-4e81-96c4-34e2463d8b83 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:26.698492 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-f396abf1-5784-4e81-96c4-34e2463d8b83 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1321 microversion: 2.1 time: 0.219117 Oct 24 08:48:26.709349 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 52/98] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:26 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:26.723702 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-d2167c34-503a-43cd-95c1-92e5eaabfee0 req-fdda0f28-2207-4833-a989-8d7239e0a8f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf8e51c6-99cf-49c6-b25b-89c3c7045e4e", "tag": "c7a98c12-528e-4bbb-9ae8-1c8aaf7fbba9"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:48:26.746947 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-d2167c34-503a-43cd-95c1-92e5eaabfee0 req-fdda0f28-2207-4833-a989-8d7239e0a8f1 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:26.747443 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-d2167c34-503a-43cd-95c1-92e5eaabfee0 req-fdda0f28-2207-4833-a989-8d7239e0a8f1 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:26.748757 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-d2167c34-503a-43cd-95c1-92e5eaabfee0 req-fdda0f28-2207-4833-a989-8d7239e0a8f1 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:26.779977 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-d2167c34-503a-43cd-95c1-92e5eaabfee0 req-fdda0f28-2207-4833-a989-8d7239e0a8f1 service nova] Creating event network-changed:c7a98c12-528e-4bbb-9ae8-1c8aaf7fbba9 for instance cf8e51c6-99cf-49c6-b25b-89c3c7045e4e on hv-cinder-maste Oct 24 08:48:26.786946 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-d2167c34-503a-43cd-95c1-92e5eaabfee0 req-fdda0f28-2207-4833-a989-8d7239e0a8f1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073203 Oct 24 08:48:26.789269 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 53/99] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:48:26.858426 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-18adc910-50c6-456e-8a75-850b21cacb81 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b002748b80db40358571017d6b42ed09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa4a0e9972c4eb1963334ba4ae99a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:26.872348 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-18adc910-50c6-456e-8a75-850b21cacb81 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] 10.222.0.26 "GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb" status: 200 len: 1314 microversion: 2.1 time: 0.290077 Oct 24 08:48:26.874356 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 47/100] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:26 2022] GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:26.951978 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-7da24713-383c-40f0-958d-414124958df7 req-dd25fa62-3827-454a-8957-6352405a98f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2772d7f-d505-44ab-a062-58bd88bd49d3", "name": "network-vif-plugged", "status": "completed", "tag": "e84e11b7-68e1-423d-a896-f0d3e2146a03"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:48:26.962318 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-7da24713-383c-40f0-958d-414124958df7 req-dd25fa62-3827-454a-8957-6352405a98f6 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:26.962972 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-7da24713-383c-40f0-958d-414124958df7 req-dd25fa62-3827-454a-8957-6352405a98f6 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:26.963546 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-7da24713-383c-40f0-958d-414124958df7 req-dd25fa62-3827-454a-8957-6352405a98f6 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:26.978586 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-7da24713-383c-40f0-958d-414124958df7 req-dd25fa62-3827-454a-8957-6352405a98f6 service nova] Creating event network-vif-plugged:e84e11b7-68e1-423d-a896-f0d3e2146a03 for instance f2772d7f-d505-44ab-a062-58bd88bd49d3 on hv-cinder-maste Oct 24 08:48:26.984616 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-7da24713-383c-40f0-958d-414124958df7 req-dd25fa62-3827-454a-8957-6352405a98f6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037135 Oct 24 08:48:26.985814 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 54/101] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:48:27.250145 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-aeb6cff1-0e79-4555-b736-7d0c96835ab1 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:27.251135 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-aeb6cff1-0e79-4555-b736-7d0c96835ab1 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:27.259873 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-aeb6cff1-0e79-4555-b736-7d0c96835ab1 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:27.260576 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-aeb6cff1-0e79-4555-b736-7d0c96835ab1 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:27.261013 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-aeb6cff1-0e79-4555-b736-7d0c96835ab1 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:27.262301 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-aeb6cff1-0e79-4555-b736-7d0c96835ab1 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:27.262825 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-aeb6cff1-0e79-4555-b736-7d0c96835ab1 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:27.263234 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-aeb6cff1-0e79-4555-b736-7d0c96835ab1 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:27.264872 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-7c76eaa2-7aa2-4a74-8089-de897226a668 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:27.265621 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-7c76eaa2-7aa2-4a74-8089-de897226a668 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:27.277253 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7c76eaa2-7aa2-4a74-8089-de897226a668 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:27.277785 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7c76eaa2-7aa2-4a74-8089-de897226a668 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:27.278191 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7c76eaa2-7aa2-4a74-8089-de897226a668 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:27.278951 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7c76eaa2-7aa2-4a74-8089-de897226a668 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:27.279385 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7c76eaa2-7aa2-4a74-8089-de897226a668 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:27.279829 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7c76eaa2-7aa2-4a74-8089-de897226a668 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:27.487755 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-aeb6cff1-0e79-4555-b736-7d0c96835ab1 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:27.496082 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-aeb6cff1-0e79-4555-b736-7d0c96835ab1 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:27.497700 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-aeb6cff1-0e79-4555-b736-7d0c96835ab1 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:27.498987 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-aeb6cff1-0e79-4555-b736-7d0c96835ab1 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1406 microversion: 2.20 time: 0.253507 Oct 24 08:48:27.502669 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 48/102] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:48:27 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1406 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:48:27.515224 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-334d83c2-15de-46a8-8a67-b498b19b5c48 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:27.516086 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-334d83c2-15de-46a8-8a67-b498b19b5c48 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:27.522651 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-334d83c2-15de-46a8-8a67-b498b19b5c48 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:27.523535 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-334d83c2-15de-46a8-8a67-b498b19b5c48 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:27.524169 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-334d83c2-15de-46a8-8a67-b498b19b5c48 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:27.525117 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-334d83c2-15de-46a8-8a67-b498b19b5c48 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:27.525768 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-334d83c2-15de-46a8-8a67-b498b19b5c48 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:27.526390 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-334d83c2-15de-46a8-8a67-b498b19b5c48 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:27.533117 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-7c76eaa2-7aa2-4a74-8089-de897226a668 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:27.542930 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-7c76eaa2-7aa2-4a74-8089-de897226a668 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1364 microversion: 2.1 time: 0.282190 Oct 24 08:48:27.544066 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 55/103] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:27 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1364 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:48:27.699220 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-334d83c2-15de-46a8-8a67-b498b19b5c48 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:27.710609 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-334d83c2-15de-46a8-8a67-b498b19b5c48 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1" status: 200 len: 1368 microversion: 2.1 time: 0.206578 Oct 24 08:48:27.711620 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 49/104] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:27 2022] GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 => generated 1368 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:27.731544 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-2923971b-766f-4f96-94a3-e3bb0d7b3c58 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:27.732428 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-2923971b-766f-4f96-94a3-e3bb0d7b3c58 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:27.741529 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2923971b-766f-4f96-94a3-e3bb0d7b3c58 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:27.742301 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2923971b-766f-4f96-94a3-e3bb0d7b3c58 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:27.742938 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2923971b-766f-4f96-94a3-e3bb0d7b3c58 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:27.743827 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2923971b-766f-4f96-94a3-e3bb0d7b3c58 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:27.744284 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2923971b-766f-4f96-94a3-e3bb0d7b3c58 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:27.744871 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2923971b-766f-4f96-94a3-e3bb0d7b3c58 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:27.897404 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-a4168544-a2d0-4d52-ab7e-9b1189a27b25 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:27.898019 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-a4168544-a2d0-4d52-ab7e-9b1189a27b25 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] [instance: 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:27.907028 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-2923971b-766f-4f96-94a3-e3bb0d7b3c58 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:27.907362 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a4168544-a2d0-4d52-ab7e-9b1189a27b25 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:27.907867 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a4168544-a2d0-4d52-ab7e-9b1189a27b25 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:27.908291 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a4168544-a2d0-4d52-ab7e-9b1189a27b25 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:27.909196 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a4168544-a2d0-4d52-ab7e-9b1189a27b25 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:27.909774 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a4168544-a2d0-4d52-ab7e-9b1189a27b25 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:27.910391 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a4168544-a2d0-4d52-ab7e-9b1189a27b25 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:27.917484 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-2923971b-766f-4f96-94a3-e3bb0d7b3c58 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1321 microversion: 2.1 time: 0.190039 Oct 24 08:48:27.918056 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 56/105] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:27 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:28.076671 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a4168544-a2d0-4d52-ab7e-9b1189a27b25 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b002748b80db40358571017d6b42ed09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa4a0e9972c4eb1963334ba4ae99a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:28.085025 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-a4168544-a2d0-4d52-ab7e-9b1189a27b25 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] 10.222.0.26 "GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb" status: 200 len: 1314 microversion: 2.1 time: 0.192684 Oct 24 08:48:28.085592 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 50/106] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:27 2022] GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:48:28.525158 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-d76d58a8-6bad-41ee-a3e7-d95d3d7199db tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:28.525786 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-d76d58a8-6bad-41ee-a3e7-d95d3d7199db tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:28.531768 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d76d58a8-6bad-41ee-a3e7-d95d3d7199db tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:28.532244 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d76d58a8-6bad-41ee-a3e7-d95d3d7199db tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:28.532679 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d76d58a8-6bad-41ee-a3e7-d95d3d7199db tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:28.533465 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d76d58a8-6bad-41ee-a3e7-d95d3d7199db tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:28.534382 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d76d58a8-6bad-41ee-a3e7-d95d3d7199db tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:28.534872 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d76d58a8-6bad-41ee-a3e7-d95d3d7199db tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:28.566331 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-6bc00554-3b04-426e-9d89-da96ba90dc69 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:28.567328 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-6bc00554-3b04-426e-9d89-da96ba90dc69 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:28.581882 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6bc00554-3b04-426e-9d89-da96ba90dc69 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:28.582386 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6bc00554-3b04-426e-9d89-da96ba90dc69 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:28.582956 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6bc00554-3b04-426e-9d89-da96ba90dc69 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:28.583688 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6bc00554-3b04-426e-9d89-da96ba90dc69 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:28.584220 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6bc00554-3b04-426e-9d89-da96ba90dc69 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:28.584770 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6bc00554-3b04-426e-9d89-da96ba90dc69 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:28.732232 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-d76d58a8-6bad-41ee-a3e7-d95d3d7199db tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:28.741181 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-d76d58a8-6bad-41ee-a3e7-d95d3d7199db tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:28.742739 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-d76d58a8-6bad-41ee-a3e7-d95d3d7199db tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:28.743948 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-d76d58a8-6bad-41ee-a3e7-d95d3d7199db tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1406 microversion: 2.20 time: 0.222849 Oct 24 08:48:28.744580 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 57/107] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:48:28 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:48:28.749748 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-a08d2d95-724d-42fd-a983-7373245a53fe tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:28.750590 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-a08d2d95-724d-42fd-a983-7373245a53fe tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:28.758303 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a08d2d95-724d-42fd-a983-7373245a53fe tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:28.759203 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a08d2d95-724d-42fd-a983-7373245a53fe tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:28.759717 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a08d2d95-724d-42fd-a983-7373245a53fe tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:28.760481 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a08d2d95-724d-42fd-a983-7373245a53fe tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:28.761541 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a08d2d95-724d-42fd-a983-7373245a53fe tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:28.762031 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a08d2d95-724d-42fd-a983-7373245a53fe tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:28.769067 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-6bc00554-3b04-426e-9d89-da96ba90dc69 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:28.779387 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-6bc00554-3b04-426e-9d89-da96ba90dc69 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1364 microversion: 2.1 time: 0.217135 Oct 24 08:48:28.780063 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 51/108] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:28 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:48:28.942859 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-41d94690-971b-400a-bd61-c572d2e60529 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:28.944180 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-41d94690-971b-400a-bd61-c572d2e60529 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:28.959181 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-41d94690-971b-400a-bd61-c572d2e60529 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:28.960471 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-41d94690-971b-400a-bd61-c572d2e60529 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:28.961134 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-41d94690-971b-400a-bd61-c572d2e60529 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:28.964232 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-41d94690-971b-400a-bd61-c572d2e60529 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:28.967471 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-41d94690-971b-400a-bd61-c572d2e60529 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:28.967927 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-41d94690-971b-400a-bd61-c572d2e60529 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:28.996671 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-a08d2d95-724d-42fd-a983-7373245a53fe tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:29.013430 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-a08d2d95-724d-42fd-a983-7373245a53fe tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1" status: 200 len: 1368 microversion: 2.1 time: 0.265042 Oct 24 08:48:29.015821 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 58/109] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:28 2022] GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 => generated 1368 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:29.030942 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-406fd0f4-e6ce-436d-acaf-7bd0466efd2b req-39bfac1d-dfb4-4d48-a1b9-a8718eceba10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ca61184-c71a-4d17-bc49-b99f4d5fbbfb", "name": "network-vif-plugged", "status": "completed", "tag": "e6fd644c-236f-4c83-9c3a-375d9c0e8e0b"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:48:29.051076 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-406fd0f4-e6ce-436d-acaf-7bd0466efd2b req-39bfac1d-dfb4-4d48-a1b9-a8718eceba10 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:29.054928 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-406fd0f4-e6ce-436d-acaf-7bd0466efd2b req-39bfac1d-dfb4-4d48-a1b9-a8718eceba10 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:29.055686 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-406fd0f4-e6ce-436d-acaf-7bd0466efd2b req-39bfac1d-dfb4-4d48-a1b9-a8718eceba10 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:29.069666 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-406fd0f4-e6ce-436d-acaf-7bd0466efd2b req-39bfac1d-dfb4-4d48-a1b9-a8718eceba10 service nova] Creating event network-vif-plugged:e6fd644c-236f-4c83-9c3a-375d9c0e8e0b for instance 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb on hv-cinder-maste Oct 24 08:48:29.075986 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-406fd0f4-e6ce-436d-acaf-7bd0466efd2b req-39bfac1d-dfb4-4d48-a1b9-a8718eceba10 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058761 Oct 24 08:48:29.076900 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 59/110] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:48:29.108722 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-091f30fa-b531-4967-ab18-41776cc62ab6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:29.109677 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-091f30fa-b531-4967-ab18-41776cc62ab6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] [instance: 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:29.118032 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-091f30fa-b531-4967-ab18-41776cc62ab6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:29.120388 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-091f30fa-b531-4967-ab18-41776cc62ab6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:29.121282 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-091f30fa-b531-4967-ab18-41776cc62ab6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:29.122528 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-091f30fa-b531-4967-ab18-41776cc62ab6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:29.123288 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-091f30fa-b531-4967-ab18-41776cc62ab6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:29.123850 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-091f30fa-b531-4967-ab18-41776cc62ab6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:29.355932 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-41d94690-971b-400a-bd61-c572d2e60529 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:29.361413 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-091f30fa-b531-4967-ab18-41776cc62ab6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b002748b80db40358571017d6b42ed09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa4a0e9972c4eb1963334ba4ae99a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:29.369147 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-41d94690-971b-400a-bd61-c572d2e60529 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1321 microversion: 2.1 time: 0.432157 Oct 24 08:48:29.369697 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 52/111] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:28 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1321 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:48:29.370125 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-091f30fa-b531-4967-ab18-41776cc62ab6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] 10.222.0.26 "GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb" status: 200 len: 1314 microversion: 2.1 time: 0.266143 Oct 24 08:48:29.370986 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 60/112] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:29 2022] GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:29.773262 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-648151e3-126e-42d3-98a2-da905491b787 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:29.773916 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-648151e3-126e-42d3-98a2-da905491b787 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:29.787811 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-648151e3-126e-42d3-98a2-da905491b787 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:29.788299 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-648151e3-126e-42d3-98a2-da905491b787 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:29.788726 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-648151e3-126e-42d3-98a2-da905491b787 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:29.789416 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-648151e3-126e-42d3-98a2-da905491b787 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:29.789858 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-648151e3-126e-42d3-98a2-da905491b787 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:29.790578 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-648151e3-126e-42d3-98a2-da905491b787 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:29.804923 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-ac391dd4-7f3d-45d9-8704-f5970b5223c2 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:29.805614 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-ac391dd4-7f3d-45d9-8704-f5970b5223c2 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:29.845306 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ac391dd4-7f3d-45d9-8704-f5970b5223c2 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:29.846293 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ac391dd4-7f3d-45d9-8704-f5970b5223c2 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:29.847601 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ac391dd4-7f3d-45d9-8704-f5970b5223c2 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:29.848468 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ac391dd4-7f3d-45d9-8704-f5970b5223c2 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:29.851403 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ac391dd4-7f3d-45d9-8704-f5970b5223c2 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:29.855129 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ac391dd4-7f3d-45d9-8704-f5970b5223c2 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:30.157036 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-ac391dd4-7f3d-45d9-8704-f5970b5223c2 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:30.161050 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-648151e3-126e-42d3-98a2-da905491b787 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:30.165600 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-ac391dd4-7f3d-45d9-8704-f5970b5223c2 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1364 microversion: 2.1 time: 0.366869 Oct 24 08:48:30.166156 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 61/113] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:29 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1364 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:48:30.169446 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-648151e3-126e-42d3-98a2-da905491b787 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:30.170892 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-648151e3-126e-42d3-98a2-da905491b787 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:30.171021 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-8c336cc4-140a-489e-b45b-eb602a82cb01 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:30.171537 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-8c336cc4-140a-489e-b45b-eb602a82cb01 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:30.172023 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-648151e3-126e-42d3-98a2-da905491b787 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1406 microversion: 2.20 time: 0.403116 Oct 24 08:48:30.172650 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 53/114] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:48:29 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1406 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:48:30.177741 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8c336cc4-140a-489e-b45b-eb602a82cb01 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:30.178216 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8c336cc4-140a-489e-b45b-eb602a82cb01 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:30.178644 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8c336cc4-140a-489e-b45b-eb602a82cb01 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:30.179391 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8c336cc4-140a-489e-b45b-eb602a82cb01 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:30.179827 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8c336cc4-140a-489e-b45b-eb602a82cb01 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:30.180228 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8c336cc4-140a-489e-b45b-eb602a82cb01 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:30.366946 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-8c336cc4-140a-489e-b45b-eb602a82cb01 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:30.375836 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-8c336cc4-140a-489e-b45b-eb602a82cb01 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1" status: 200 len: 1368 microversion: 2.1 time: 0.208664 Oct 24 08:48:30.376667 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 62/115] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:30 2022] GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 => generated 1368 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:30.396295 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-0bb5abf9-1fe7-4c62-94ba-987966050240 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:30.396475 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-6aa2d7d3-616b-4163-9d62-6226b0888aab tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:30.396897 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-0bb5abf9-1fe7-4c62-94ba-987966050240 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] [instance: 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:30.397069 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-6aa2d7d3-616b-4163-9d62-6226b0888aab tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:30.403068 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0bb5abf9-1fe7-4c62-94ba-987966050240 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:30.403835 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0bb5abf9-1fe7-4c62-94ba-987966050240 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:30.404444 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0bb5abf9-1fe7-4c62-94ba-987966050240 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:30.405478 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0bb5abf9-1fe7-4c62-94ba-987966050240 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:30.405960 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0bb5abf9-1fe7-4c62-94ba-987966050240 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:30.406354 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0bb5abf9-1fe7-4c62-94ba-987966050240 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:30.412185 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6aa2d7d3-616b-4163-9d62-6226b0888aab tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:30.412677 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6aa2d7d3-616b-4163-9d62-6226b0888aab tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:30.413249 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6aa2d7d3-616b-4163-9d62-6226b0888aab tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:30.413947 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6aa2d7d3-616b-4163-9d62-6226b0888aab tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:30.414569 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6aa2d7d3-616b-4163-9d62-6226b0888aab tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:30.415005 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6aa2d7d3-616b-4163-9d62-6226b0888aab tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:30.608768 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-0bb5abf9-1fe7-4c62-94ba-987966050240 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b002748b80db40358571017d6b42ed09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa4a0e9972c4eb1963334ba4ae99a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:30.612065 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-6aa2d7d3-616b-4163-9d62-6226b0888aab tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:30.616659 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-0bb5abf9-1fe7-4c62-94ba-987966050240 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] 10.222.0.26 "GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb" status: 200 len: 1314 microversion: 2.1 time: 0.224713 Oct 24 08:48:30.617230 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 54/116] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:30 2022] GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:30.620129 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-6aa2d7d3-616b-4163-9d62-6226b0888aab tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1321 microversion: 2.1 time: 0.228177 Oct 24 08:48:30.620741 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 63/117] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:30 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:31.191045 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-ecf6839f-a7d5-4e46-a282-a9390df281b6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:31.191834 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-ecf6839f-a7d5-4e46-a282-a9390df281b6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:31.197848 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-c2d68fee-6658-4c86-9f01-c316ec0a452a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:31.198310 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ecf6839f-a7d5-4e46-a282-a9390df281b6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:31.198827 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-c2d68fee-6658-4c86-9f01-c316ec0a452a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:31.198994 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ecf6839f-a7d5-4e46-a282-a9390df281b6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:31.199654 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ecf6839f-a7d5-4e46-a282-a9390df281b6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:31.200505 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ecf6839f-a7d5-4e46-a282-a9390df281b6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:31.201050 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ecf6839f-a7d5-4e46-a282-a9390df281b6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:31.201559 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ecf6839f-a7d5-4e46-a282-a9390df281b6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:31.204841 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c2d68fee-6658-4c86-9f01-c316ec0a452a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:31.205315 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c2d68fee-6658-4c86-9f01-c316ec0a452a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:31.207282 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c2d68fee-6658-4c86-9f01-c316ec0a452a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:31.207993 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c2d68fee-6658-4c86-9f01-c316ec0a452a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:31.208445 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c2d68fee-6658-4c86-9f01-c316ec0a452a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:31.208898 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c2d68fee-6658-4c86-9f01-c316ec0a452a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:31.418930 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-c2d68fee-6658-4c86-9f01-c316ec0a452a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:31.425338 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-ecf6839f-a7d5-4e46-a282-a9390df281b6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:31.429143 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-c2d68fee-6658-4c86-9f01-c316ec0a452a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:31.430566 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-c2d68fee-6658-4c86-9f01-c316ec0a452a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:31.431834 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-c2d68fee-6658-4c86-9f01-c316ec0a452a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1406 microversion: 2.20 time: 0.238089 Oct 24 08:48:31.432259 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 64/118] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:48:31 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1406 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:48:31.442910 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-ecf6839f-a7d5-4e46-a282-a9390df281b6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1364 microversion: 2.1 time: 0.248468 Oct 24 08:48:31.442910 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 55/119] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:31 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1364 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:31.443288 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-774ba09a-6e98-4611-aebc-a8a1c496a2db tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:31.446751 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-774ba09a-6e98-4611-aebc-a8a1c496a2db tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:31.451449 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-774ba09a-6e98-4611-aebc-a8a1c496a2db tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:31.451986 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-774ba09a-6e98-4611-aebc-a8a1c496a2db tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:31.452515 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-774ba09a-6e98-4611-aebc-a8a1c496a2db tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:31.453243 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-774ba09a-6e98-4611-aebc-a8a1c496a2db tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:31.453684 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-774ba09a-6e98-4611-aebc-a8a1c496a2db tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:31.454095 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-774ba09a-6e98-4611-aebc-a8a1c496a2db tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:31.636598 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-774ba09a-6e98-4611-aebc-a8a1c496a2db tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:31.642477 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-cf89eb9e-93a9-4470-af30-78a0982f54c8 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:31.643533 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-cf89eb9e-93a9-4470-af30-78a0982f54c8 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] [instance: 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:31.645789 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-774ba09a-6e98-4611-aebc-a8a1c496a2db tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1" status: 200 len: 1368 microversion: 2.1 time: 0.210493 Oct 24 08:48:31.649690 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cf89eb9e-93a9-4470-af30-78a0982f54c8 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:31.650366 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cf89eb9e-93a9-4470-af30-78a0982f54c8 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:31.650969 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cf89eb9e-93a9-4470-af30-78a0982f54c8 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:31.652573 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cf89eb9e-93a9-4470-af30-78a0982f54c8 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:31.653158 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cf89eb9e-93a9-4470-af30-78a0982f54c8 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:31.653706 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cf89eb9e-93a9-4470-af30-78a0982f54c8 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:31.659499 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 56/120] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:31 2022] GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 => generated 1368 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:31.668835 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-3d0bdf0b-9bf7-4afd-8858-93a84991baf1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:31.669817 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-3d0bdf0b-9bf7-4afd-8858-93a84991baf1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:31.676671 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3d0bdf0b-9bf7-4afd-8858-93a84991baf1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:31.677428 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3d0bdf0b-9bf7-4afd-8858-93a84991baf1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:31.678066 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3d0bdf0b-9bf7-4afd-8858-93a84991baf1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:31.678994 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3d0bdf0b-9bf7-4afd-8858-93a84991baf1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:31.679621 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3d0bdf0b-9bf7-4afd-8858-93a84991baf1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:31.680261 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3d0bdf0b-9bf7-4afd-8858-93a84991baf1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:31.857712 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-cf89eb9e-93a9-4470-af30-78a0982f54c8 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b002748b80db40358571017d6b42ed09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa4a0e9972c4eb1963334ba4ae99a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:31.865759 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-cf89eb9e-93a9-4470-af30-78a0982f54c8 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] 10.222.0.26 "GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb" status: 200 len: 1314 microversion: 2.1 time: 0.229537 Oct 24 08:48:31.866335 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 65/121] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:31 2022] GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:48:31.885394 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-3d0bdf0b-9bf7-4afd-8858-93a84991baf1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:31.887602 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell1:SELECT=100 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:48:31.894826 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-3d0bdf0b-9bf7-4afd-8858-93a84991baf1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1321 microversion: 2.1 time: 0.234114 Oct 24 08:48:31.895518 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 57/122] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:31 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:32.455398 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-50969e11-f88b-43e1-8390-3a103ccaafa9 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:32.456002 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-50969e11-f88b-43e1-8390-3a103ccaafa9 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:32.460083 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-6819ed0e-7690-4284-9a0b-92b321376087 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:32.461260 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-6819ed0e-7690-4284-9a0b-92b321376087 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:32.464884 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-50969e11-f88b-43e1-8390-3a103ccaafa9 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:32.468971 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6819ed0e-7690-4284-9a0b-92b321376087 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:32.469698 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6819ed0e-7690-4284-9a0b-92b321376087 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:32.470008 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-50969e11-f88b-43e1-8390-3a103ccaafa9 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:32.470449 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-50969e11-f88b-43e1-8390-3a103ccaafa9 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:32.470837 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6819ed0e-7690-4284-9a0b-92b321376087 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:32.471192 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-50969e11-f88b-43e1-8390-3a103ccaafa9 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:32.471641 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-50969e11-f88b-43e1-8390-3a103ccaafa9 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:32.472050 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-50969e11-f88b-43e1-8390-3a103ccaafa9 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:32.472708 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6819ed0e-7690-4284-9a0b-92b321376087 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:32.473365 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6819ed0e-7690-4284-9a0b-92b321376087 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:32.474143 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6819ed0e-7690-4284-9a0b-92b321376087 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:32.717789 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-50969e11-f88b-43e1-8390-3a103ccaafa9 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:32.738409 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-50969e11-f88b-43e1-8390-3a103ccaafa9 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1550 microversion: 2.1 time: 0.286924 Oct 24 08:48:32.739019 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 66/123] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:32 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1550 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:32.744107 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-6819ed0e-7690-4284-9a0b-92b321376087 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:32.755537 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-6819ed0e-7690-4284-9a0b-92b321376087 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:32.757574 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-6819ed0e-7690-4284-9a0b-92b321376087 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:32.758796 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-6819ed0e-7690-4284-9a0b-92b321376087 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1406 microversion: 2.20 time: 0.304994 Oct 24 08:48:32.759681 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 58/124] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:48:32 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1406 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:48:32.762879 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-b7a5c0d7-c7fa-49da-ac5c-cade705d24be tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:32.763642 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-b7a5c0d7-c7fa-49da-ac5c-cade705d24be tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:32.764363 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-96f3c49e-6a13-4793-99c6-8d0e6ee50663 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:32.764855 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-96f3c49e-6a13-4793-99c6-8d0e6ee50663 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:32.770263 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b7a5c0d7-c7fa-49da-ac5c-cade705d24be tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:32.771026 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b7a5c0d7-c7fa-49da-ac5c-cade705d24be tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:32.771382 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-96f3c49e-6a13-4793-99c6-8d0e6ee50663 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:32.772028 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b7a5c0d7-c7fa-49da-ac5c-cade705d24be tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:32.772182 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-96f3c49e-6a13-4793-99c6-8d0e6ee50663 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:32.772749 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-96f3c49e-6a13-4793-99c6-8d0e6ee50663 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:32.772926 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b7a5c0d7-c7fa-49da-ac5c-cade705d24be tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:32.773634 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-96f3c49e-6a13-4793-99c6-8d0e6ee50663 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:32.773746 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b7a5c0d7-c7fa-49da-ac5c-cade705d24be tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:32.774092 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-96f3c49e-6a13-4793-99c6-8d0e6ee50663 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:32.774473 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b7a5c0d7-c7fa-49da-ac5c-cade705d24be tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:32.775247 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-96f3c49e-6a13-4793-99c6-8d0e6ee50663 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:33.011663 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-96f3c49e-6a13-4793-99c6-8d0e6ee50663 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.250814 Oct 24 08:48:33.012442 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 59/125] 10.222.0.26 () {58 vars in 1275 bytes} [Mon Oct 24 08:48:32 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a/os-interface => generated 284 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:48:33.017184 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-f131732a-e48a-4991-8a56-f30c62234018 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:33.017789 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-f131732a-e48a-4991-8a56-f30c62234018 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] [instance: 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:33.023729 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-b7a5c0d7-c7fa-49da-ac5c-cade705d24be tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:33.024246 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f131732a-e48a-4991-8a56-f30c62234018 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:33.024893 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f131732a-e48a-4991-8a56-f30c62234018 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:33.025752 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f131732a-e48a-4991-8a56-f30c62234018 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:33.026846 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f131732a-e48a-4991-8a56-f30c62234018 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:33.027592 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f131732a-e48a-4991-8a56-f30c62234018 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:33.028153 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f131732a-e48a-4991-8a56-f30c62234018 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:33.033412 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-b7a5c0d7-c7fa-49da-ac5c-cade705d24be tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1" status: 200 len: 1368 microversion: 2.1 time: 0.290890 Oct 24 08:48:33.034246 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 67/126] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:32 2022] GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 => generated 1368 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:33.054280 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-cb7c497f-49bf-4eb9-bd0c-41e2055e890f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:33.055125 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-cb7c497f-49bf-4eb9-bd0c-41e2055e890f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:33.061582 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cb7c497f-49bf-4eb9-bd0c-41e2055e890f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:33.062181 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cb7c497f-49bf-4eb9-bd0c-41e2055e890f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:33.062701 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cb7c497f-49bf-4eb9-bd0c-41e2055e890f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:33.063496 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cb7c497f-49bf-4eb9-bd0c-41e2055e890f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:33.064056 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cb7c497f-49bf-4eb9-bd0c-41e2055e890f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:33.064564 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cb7c497f-49bf-4eb9-bd0c-41e2055e890f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:33.537602 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-f131732a-e48a-4991-8a56-f30c62234018 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b002748b80db40358571017d6b42ed09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa4a0e9972c4eb1963334ba4ae99a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:33.547287 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-f131732a-e48a-4991-8a56-f30c62234018 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] 10.222.0.26 "GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb" status: 200 len: 1314 microversion: 2.1 time: 0.533757 Oct 24 08:48:33.547853 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 60/127] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:33 2022] GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb => generated 1314 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:33.552114 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-cb7c497f-49bf-4eb9-bd0c-41e2055e890f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:33.561196 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-cb7c497f-49bf-4eb9-bd0c-41e2055e890f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1321 microversion: 2.1 time: 0.513018 Oct 24 08:48:33.561756 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 68/128] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:33 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1321 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:33.574007 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-456f56e3-d8ee-4df3-a2b6-94379b4efbb9 req-7a653334-baa1-4669-9e9a-bfb9b618ce3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6890641-4753-4fb7-86a4-fb5782b1b5b1", "name": "network-vif-plugged", "status": "completed", "tag": "20f1d856-5c54-4f99-8f43-55b3a29d8726"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:48:33.583514 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-456f56e3-d8ee-4df3-a2b6-94379b4efbb9 req-7a653334-baa1-4669-9e9a-bfb9b618ce3e service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:33.584016 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-456f56e3-d8ee-4df3-a2b6-94379b4efbb9 req-7a653334-baa1-4669-9e9a-bfb9b618ce3e service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:33.584435 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-456f56e3-d8ee-4df3-a2b6-94379b4efbb9 req-7a653334-baa1-4669-9e9a-bfb9b618ce3e service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:33.595628 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-456f56e3-d8ee-4df3-a2b6-94379b4efbb9 req-7a653334-baa1-4669-9e9a-bfb9b618ce3e service nova] Creating event network-vif-plugged:20f1d856-5c54-4f99-8f43-55b3a29d8726 for instance f6890641-4753-4fb7-86a4-fb5782b1b5b1 on hv-cinder-maste Oct 24 08:48:33.600918 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-456f56e3-d8ee-4df3-a2b6-94379b4efbb9 req-7a653334-baa1-4669-9e9a-bfb9b618ce3e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051757 Oct 24 08:48:33.601562 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 61/129] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:48:33.788374 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-6cc57dfb-6c46-4632-b4e3-9bfa9a0e300b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:33.789029 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-6cc57dfb-6c46-4632-b4e3-9bfa9a0e300b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:33.795651 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6cc57dfb-6c46-4632-b4e3-9bfa9a0e300b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:33.796619 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6cc57dfb-6c46-4632-b4e3-9bfa9a0e300b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:33.797731 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6cc57dfb-6c46-4632-b4e3-9bfa9a0e300b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:33.798654 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6cc57dfb-6c46-4632-b4e3-9bfa9a0e300b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:33.799321 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6cc57dfb-6c46-4632-b4e3-9bfa9a0e300b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:33.799999 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6cc57dfb-6c46-4632-b4e3-9bfa9a0e300b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:33.841718 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell1:SELECT=100 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:48:34.063276 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-f7353400-b65a-44b4-b656-17a8f4b27ffd tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:34.064348 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-f7353400-b65a-44b4-b656-17a8f4b27ffd tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:34.074022 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f7353400-b65a-44b4-b656-17a8f4b27ffd tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:34.075035 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f7353400-b65a-44b4-b656-17a8f4b27ffd tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:34.075658 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f7353400-b65a-44b4-b656-17a8f4b27ffd tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:34.076549 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f7353400-b65a-44b4-b656-17a8f4b27ffd tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:34.077050 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f7353400-b65a-44b4-b656-17a8f4b27ffd tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:34.077724 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f7353400-b65a-44b4-b656-17a8f4b27ffd tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:34.495801 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-6cc57dfb-6c46-4632-b4e3-9bfa9a0e300b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:34.505247 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-6cc57dfb-6c46-4632-b4e3-9bfa9a0e300b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:34.506651 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-6cc57dfb-6c46-4632-b4e3-9bfa9a0e300b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:34.507818 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-6cc57dfb-6c46-4632-b4e3-9bfa9a0e300b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1406 microversion: 2.20 time: 0.724452 Oct 24 08:48:34.513088 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 69/130] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:48:33 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1406 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:48:34.574602 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-9cb1c152-a82c-4a10-8682-e58a38f18717 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:34.579195 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-9cb1c152-a82c-4a10-8682-e58a38f18717 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] [instance: 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:34.589964 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9cb1c152-a82c-4a10-8682-e58a38f18717 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:34.591220 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9cb1c152-a82c-4a10-8682-e58a38f18717 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:34.591689 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9cb1c152-a82c-4a10-8682-e58a38f18717 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:34.592416 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9cb1c152-a82c-4a10-8682-e58a38f18717 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:34.593062 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9cb1c152-a82c-4a10-8682-e58a38f18717 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:34.593669 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9cb1c152-a82c-4a10-8682-e58a38f18717 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:34.700159 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-f7353400-b65a-44b4-b656-17a8f4b27ffd tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:34.708445 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-f7353400-b65a-44b4-b656-17a8f4b27ffd tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1" status: 200 len: 1368 microversion: 2.1 time: 0.651513 Oct 24 08:48:34.723795 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 62/131] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:34 2022] GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 => generated 1368 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:48:34.736657 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-6b801732-37e7-40e0-926a-a3dd5960b0a3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:34.738035 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-6b801732-37e7-40e0-926a-a3dd5960b0a3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:34.747834 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6b801732-37e7-40e0-926a-a3dd5960b0a3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:34.748673 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6b801732-37e7-40e0-926a-a3dd5960b0a3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:34.758541 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6b801732-37e7-40e0-926a-a3dd5960b0a3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:34.758541 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6b801732-37e7-40e0-926a-a3dd5960b0a3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:34.759976 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6b801732-37e7-40e0-926a-a3dd5960b0a3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:34.765586 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6b801732-37e7-40e0-926a-a3dd5960b0a3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:34.969047 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-9cb1c152-a82c-4a10-8682-e58a38f18717 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b002748b80db40358571017d6b42ed09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa4a0e9972c4eb1963334ba4ae99a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:34.977975 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-9cb1c152-a82c-4a10-8682-e58a38f18717 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] 10.222.0.26 "GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb" status: 200 len: 1501 microversion: 2.1 time: 0.408233 Oct 24 08:48:34.983852 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 70/132] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:34 2022] GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb => generated 1501 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:35.068761 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-6b801732-37e7-40e0-926a-a3dd5960b0a3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:35.091851 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-6b801732-37e7-40e0-926a-a3dd5960b0a3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1321 microversion: 2.1 time: 0.366276 Oct 24 08:48:35.093880 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 63/133] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:34 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1321 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:35.322654 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-14770364-af85-4700-a760-575153fbb21c req-67daa8cf-733a-4875-924a-b29d57df1823 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "031a03be-3f3b-46dd-944c-6e68a9d8b09a", "tag": "634028ec-acae-487c-82c9-606115b581ba"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:48:35.334529 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-14770364-af85-4700-a760-575153fbb21c req-67daa8cf-733a-4875-924a-b29d57df1823 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:35.335604 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-14770364-af85-4700-a760-575153fbb21c req-67daa8cf-733a-4875-924a-b29d57df1823 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:35.336330 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-14770364-af85-4700-a760-575153fbb21c req-67daa8cf-733a-4875-924a-b29d57df1823 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:35.354783 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-14770364-af85-4700-a760-575153fbb21c req-67daa8cf-733a-4875-924a-b29d57df1823 service nova] Creating event network-changed:634028ec-acae-487c-82c9-606115b581ba for instance 031a03be-3f3b-46dd-944c-6e68a9d8b09a on hv-cinder-maste Oct 24 08:48:35.362094 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-14770364-af85-4700-a760-575153fbb21c req-67daa8cf-733a-4875-924a-b29d57df1823 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045264 Oct 24 08:48:35.363829 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 71/134] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:48:35.536786 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-4055b062-1a2f-40fc-89cb-1db5f3e1dec6 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:35.537714 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-4055b062-1a2f-40fc-89cb-1db5f3e1dec6 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:35.547882 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4055b062-1a2f-40fc-89cb-1db5f3e1dec6 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:35.548367 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4055b062-1a2f-40fc-89cb-1db5f3e1dec6 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:35.548802 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4055b062-1a2f-40fc-89cb-1db5f3e1dec6 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:35.549563 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4055b062-1a2f-40fc-89cb-1db5f3e1dec6 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:35.553461 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4055b062-1a2f-40fc-89cb-1db5f3e1dec6 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:35.554626 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4055b062-1a2f-40fc-89cb-1db5f3e1dec6 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:35.732784 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-768cfeca-f653-47bb-8020-be5667c8a205 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:35.733728 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-768cfeca-f653-47bb-8020-be5667c8a205 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:35.751778 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-768cfeca-f653-47bb-8020-be5667c8a205 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:35.753922 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-768cfeca-f653-47bb-8020-be5667c8a205 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:35.758001 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-768cfeca-f653-47bb-8020-be5667c8a205 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:35.758964 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-768cfeca-f653-47bb-8020-be5667c8a205 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:35.762570 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-768cfeca-f653-47bb-8020-be5667c8a205 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:35.763208 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-768cfeca-f653-47bb-8020-be5667c8a205 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:35.771702 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-4055b062-1a2f-40fc-89cb-1db5f3e1dec6 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:35.781935 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-4055b062-1a2f-40fc-89cb-1db5f3e1dec6 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:35.784089 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-4055b062-1a2f-40fc-89cb-1db5f3e1dec6 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:35.785405 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-4055b062-1a2f-40fc-89cb-1db5f3e1dec6 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1406 microversion: 2.20 time: 0.253446 Oct 24 08:48:35.786110 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 64/135] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:48:35 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1406 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:48:35.990570 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-768cfeca-f653-47bb-8020-be5667c8a205 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:36.001477 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-768cfeca-f653-47bb-8020-be5667c8a205 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1" status: 200 len: 1368 microversion: 2.1 time: 0.273018 Oct 24 08:48:36.013338 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 72/136] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:35 2022] GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 => generated 1368 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:36.120085 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-a57b4f98-f32a-4575-ba73-765fdbdc3344 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:36.121016 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-a57b4f98-f32a-4575-ba73-765fdbdc3344 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:36.138307 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a57b4f98-f32a-4575-ba73-765fdbdc3344 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:36.138955 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a57b4f98-f32a-4575-ba73-765fdbdc3344 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:36.139249 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a57b4f98-f32a-4575-ba73-765fdbdc3344 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:36.141460 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a57b4f98-f32a-4575-ba73-765fdbdc3344 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:36.144223 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a57b4f98-f32a-4575-ba73-765fdbdc3344 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:36.144690 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a57b4f98-f32a-4575-ba73-765fdbdc3344 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:36.297693 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a57b4f98-f32a-4575-ba73-765fdbdc3344 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:36.308222 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-a57b4f98-f32a-4575-ba73-765fdbdc3344 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1321 microversion: 2.1 time: 0.192669 Oct 24 08:48:36.309321 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 65/137] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:36 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1321 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:48:36.573335 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-9dbbe0ce-178b-489f-aa3c-3ad03110fa0c tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba84634c-2b79-4d22-b4a9-72cba15b8c43"}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:48:36.576258 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-9dbbe0ce-178b-489f-aa3c-3ad03110fa0c tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] [instance: 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:36.587794 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9dbbe0ce-178b-489f-aa3c-3ad03110fa0c tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:36.592166 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9dbbe0ce-178b-489f-aa3c-3ad03110fa0c tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:36.592617 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9dbbe0ce-178b-489f-aa3c-3ad03110fa0c tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:36.593497 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9dbbe0ce-178b-489f-aa3c-3ad03110fa0c tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:36.594061 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9dbbe0ce-178b-489f-aa3c-3ad03110fa0c tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:36.594562 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9dbbe0ce-178b-489f-aa3c-3ad03110fa0c tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:36.813580 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-31037636-879c-406b-8f84-1d6bea08d86c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:36.814308 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-31037636-879c-406b-8f84-1d6bea08d86c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:36.820836 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-31037636-879c-406b-8f84-1d6bea08d86c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:36.821295 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-31037636-879c-406b-8f84-1d6bea08d86c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:36.821727 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-31037636-879c-406b-8f84-1d6bea08d86c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:36.822416 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-31037636-879c-406b-8f84-1d6bea08d86c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:36.823034 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-31037636-879c-406b-8f84-1d6bea08d86c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:36.823437 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-31037636-879c-406b-8f84-1d6bea08d86c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:36.960490 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-31037636-879c-406b-8f84-1d6bea08d86c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:36.969026 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-31037636-879c-406b-8f84-1d6bea08d86c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:36.970438 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-31037636-879c-406b-8f84-1d6bea08d86c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:36.971609 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-31037636-879c-406b-8f84-1d6bea08d86c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1406 microversion: 2.20 time: 0.162795 Oct 24 08:48:36.972156 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 66/138] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:48:36 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:48:37.023907 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-b834168f-d8a9-4d04-a53a-c58015cdcb00 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:37.024631 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-b834168f-d8a9-4d04-a53a-c58015cdcb00 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:37.030630 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b834168f-d8a9-4d04-a53a-c58015cdcb00 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:37.031139 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b834168f-d8a9-4d04-a53a-c58015cdcb00 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:37.031568 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b834168f-d8a9-4d04-a53a-c58015cdcb00 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:37.032246 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b834168f-d8a9-4d04-a53a-c58015cdcb00 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:37.032690 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b834168f-d8a9-4d04-a53a-c58015cdcb00 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:37.033125 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b834168f-d8a9-4d04-a53a-c58015cdcb00 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:37.165803 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-b834168f-d8a9-4d04-a53a-c58015cdcb00 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:37.173662 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-b834168f-d8a9-4d04-a53a-c58015cdcb00 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1" status: 200 len: 1368 microversion: 2.1 time: 0.153594 Oct 24 08:48:37.174223 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 67/139] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:37 2022] GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:48:37.332492 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-fb72fd8f-b8b5-40fa-8286-0d2b40bccd89 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:37.333505 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-fb72fd8f-b8b5-40fa-8286-0d2b40bccd89 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:37.340674 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-fb72fd8f-b8b5-40fa-8286-0d2b40bccd89 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:37.341243 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-fb72fd8f-b8b5-40fa-8286-0d2b40bccd89 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:37.341773 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-fb72fd8f-b8b5-40fa-8286-0d2b40bccd89 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:37.342504 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-fb72fd8f-b8b5-40fa-8286-0d2b40bccd89 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:37.343045 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-fb72fd8f-b8b5-40fa-8286-0d2b40bccd89 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:37.343489 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-fb72fd8f-b8b5-40fa-8286-0d2b40bccd89 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:37.474747 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-fb72fd8f-b8b5-40fa-8286-0d2b40bccd89 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:37.486252 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-fb72fd8f-b8b5-40fa-8286-0d2b40bccd89 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1321 microversion: 2.1 time: 0.157393 Oct 24 08:48:37.486924 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 68/140] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:37 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:48:38.000919 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-ac1ba12a-5a1b-4d52-824a-4e4e43891ab9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:38.001996 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-ac1ba12a-5a1b-4d52-824a-4e4e43891ab9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:38.011899 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ac1ba12a-5a1b-4d52-824a-4e4e43891ab9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:38.012699 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ac1ba12a-5a1b-4d52-824a-4e4e43891ab9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:38.013406 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ac1ba12a-5a1b-4d52-824a-4e4e43891ab9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:38.014524 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ac1ba12a-5a1b-4d52-824a-4e4e43891ab9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:38.015316 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ac1ba12a-5a1b-4d52-824a-4e4e43891ab9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:38.016012 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ac1ba12a-5a1b-4d52-824a-4e4e43891ab9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:38.152011 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-ac1ba12a-5a1b-4d52-824a-4e4e43891ab9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:38.160306 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-ac1ba12a-5a1b-4d52-824a-4e4e43891ab9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:38.161767 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-ac1ba12a-5a1b-4d52-824a-4e4e43891ab9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:38.162894 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-ac1ba12a-5a1b-4d52-824a-4e4e43891ab9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1406 microversion: 2.20 time: 0.168814 Oct 24 08:48:38.163460 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 69/141] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:48:37 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:48:38.198110 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-e1aee21c-f489-4549-9e8e-3d01dadccdd9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:38.199440 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-e1aee21c-f489-4549-9e8e-3d01dadccdd9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:38.207224 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e1aee21c-f489-4549-9e8e-3d01dadccdd9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:38.207699 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e1aee21c-f489-4549-9e8e-3d01dadccdd9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:38.208122 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e1aee21c-f489-4549-9e8e-3d01dadccdd9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:38.208781 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e1aee21c-f489-4549-9e8e-3d01dadccdd9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:38.209224 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e1aee21c-f489-4549-9e8e-3d01dadccdd9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:38.209638 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e1aee21c-f489-4549-9e8e-3d01dadccdd9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:38.401575 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-e1aee21c-f489-4549-9e8e-3d01dadccdd9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:38.410844 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-e1aee21c-f489-4549-9e8e-3d01dadccdd9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1" status: 200 len: 1368 microversion: 2.1 time: 0.216831 Oct 24 08:48:38.412122 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 70/142] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:38 2022] GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 => generated 1368 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:38.513489 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-d067163f-26d3-432e-80a6-d8d205783310 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:38.514138 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-d067163f-26d3-432e-80a6-d8d205783310 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:38.517081 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=98 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:48:38.539526 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d067163f-26d3-432e-80a6-d8d205783310 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:38.541232 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d067163f-26d3-432e-80a6-d8d205783310 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:38.541863 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d067163f-26d3-432e-80a6-d8d205783310 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:38.542840 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d067163f-26d3-432e-80a6-d8d205783310 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:38.543491 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d067163f-26d3-432e-80a6-d8d205783310 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:38.544106 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d067163f-26d3-432e-80a6-d8d205783310 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:38.746996 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-9dbbe0ce-178b-489f-aa3c-3ad03110fa0c tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] 10.222.0.26 "POST /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.177666 Oct 24 08:48:38.753111 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 73/143] 10.222.0.26 () {60 vars in 1323 bytes} [Mon Oct 24 08:48:36 2022] POST /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb/os-volume_attachments => generated 194 bytes in 2180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:48:38.753949 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-d067163f-26d3-432e-80a6-d8d205783310 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:38.763388 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-d067163f-26d3-432e-80a6-d8d205783310 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1321 microversion: 2.1 time: 0.254991 Oct 24 08:48:38.764251 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 71/144] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:38 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1321 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:48:39.189379 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-99db7b81-be3c-4bb2-8fd5-1d3ae3d2113c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:39.190106 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-99db7b81-be3c-4bb2-8fd5-1d3ae3d2113c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:39.196866 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-99db7b81-be3c-4bb2-8fd5-1d3ae3d2113c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:39.197352 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-99db7b81-be3c-4bb2-8fd5-1d3ae3d2113c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:39.197787 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-99db7b81-be3c-4bb2-8fd5-1d3ae3d2113c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:39.198468 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-99db7b81-be3c-4bb2-8fd5-1d3ae3d2113c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:39.199093 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-99db7b81-be3c-4bb2-8fd5-1d3ae3d2113c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:39.199474 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-99db7b81-be3c-4bb2-8fd5-1d3ae3d2113c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:39.336189 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-99db7b81-be3c-4bb2-8fd5-1d3ae3d2113c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:39.344398 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-99db7b81-be3c-4bb2-8fd5-1d3ae3d2113c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:39.345843 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-99db7b81-be3c-4bb2-8fd5-1d3ae3d2113c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:39.346995 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-99db7b81-be3c-4bb2-8fd5-1d3ae3d2113c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1406 microversion: 2.20 time: 0.162478 Oct 24 08:48:39.347552 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 74/145] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:48:39 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:48:39.438820 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-b4fe71d2-9b51-4ac0-9b7b-102799cc60e9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:39.439490 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-b4fe71d2-9b51-4ac0-9b7b-102799cc60e9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:39.445977 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b4fe71d2-9b51-4ac0-9b7b-102799cc60e9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:39.446511 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b4fe71d2-9b51-4ac0-9b7b-102799cc60e9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:39.446980 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b4fe71d2-9b51-4ac0-9b7b-102799cc60e9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:39.447651 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b4fe71d2-9b51-4ac0-9b7b-102799cc60e9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:39.448091 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b4fe71d2-9b51-4ac0-9b7b-102799cc60e9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:39.448534 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b4fe71d2-9b51-4ac0-9b7b-102799cc60e9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:39.579641 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-b4fe71d2-9b51-4ac0-9b7b-102799cc60e9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:39.587309 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-b4fe71d2-9b51-4ac0-9b7b-102799cc60e9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1" status: 200 len: 1368 microversion: 2.1 time: 0.152654 Oct 24 08:48:39.587802 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 72/146] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:39 2022] GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:39.788013 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-f4ca1ab2-b607-4714-84bd-238a44439e56 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:39.788687 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-f4ca1ab2-b607-4714-84bd-238a44439e56 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:39.795453 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f4ca1ab2-b607-4714-84bd-238a44439e56 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:39.795927 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f4ca1ab2-b607-4714-84bd-238a44439e56 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:39.796356 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f4ca1ab2-b607-4714-84bd-238a44439e56 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:39.797036 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f4ca1ab2-b607-4714-84bd-238a44439e56 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:39.797487 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f4ca1ab2-b607-4714-84bd-238a44439e56 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:39.797931 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f4ca1ab2-b607-4714-84bd-238a44439e56 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:39.938382 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-f4ca1ab2-b607-4714-84bd-238a44439e56 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:39.946254 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-f4ca1ab2-b607-4714-84bd-238a44439e56 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1321 microversion: 2.1 time: 0.162941 Oct 24 08:48:39.947138 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 75/147] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:39 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:40.376542 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-4e9ea175-6a94-4257-879e-0c28ebab33af tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:40.380245 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-4e9ea175-6a94-4257-879e-0c28ebab33af tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:40.387502 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4e9ea175-6a94-4257-879e-0c28ebab33af tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:40.388249 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4e9ea175-6a94-4257-879e-0c28ebab33af tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:40.388880 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4e9ea175-6a94-4257-879e-0c28ebab33af tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:40.389772 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4e9ea175-6a94-4257-879e-0c28ebab33af tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:40.390320 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4e9ea175-6a94-4257-879e-0c28ebab33af tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:40.390959 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4e9ea175-6a94-4257-879e-0c28ebab33af tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:40.546421 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-4e9ea175-6a94-4257-879e-0c28ebab33af tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:40.556088 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-4e9ea175-6a94-4257-879e-0c28ebab33af tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:40.557557 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-4e9ea175-6a94-4257-879e-0c28ebab33af tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:40.558648 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-4e9ea175-6a94-4257-879e-0c28ebab33af tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1406 microversion: 2.20 time: 0.190710 Oct 24 08:48:40.559621 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 73/148] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:48:40 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:48:40.610394 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-dd34c701-c22b-4ca6-aa6f-1f56ff6de736 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:40.611349 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-dd34c701-c22b-4ca6-aa6f-1f56ff6de736 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:40.619355 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-dd34c701-c22b-4ca6-aa6f-1f56ff6de736 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:40.620158 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-dd34c701-c22b-4ca6-aa6f-1f56ff6de736 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:40.620770 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-dd34c701-c22b-4ca6-aa6f-1f56ff6de736 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:40.621466 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-dd34c701-c22b-4ca6-aa6f-1f56ff6de736 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:40.622085 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-dd34c701-c22b-4ca6-aa6f-1f56ff6de736 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:40.622669 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-dd34c701-c22b-4ca6-aa6f-1f56ff6de736 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:40.808153 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-dd34c701-c22b-4ca6-aa6f-1f56ff6de736 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:40.818895 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-dd34c701-c22b-4ca6-aa6f-1f56ff6de736 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1" status: 200 len: 1368 microversion: 2.1 time: 0.212169 Oct 24 08:48:40.819463 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 76/149] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:40 2022] GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 => generated 1368 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:40.970279 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-a49bc825-f055-4124-abb0-ec95412d6f74 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:40.971144 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-a49bc825-f055-4124-abb0-ec95412d6f74 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:40.983586 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a49bc825-f055-4124-abb0-ec95412d6f74 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:40.985866 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a49bc825-f055-4124-abb0-ec95412d6f74 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:40.986638 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a49bc825-f055-4124-abb0-ec95412d6f74 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:40.989758 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a49bc825-f055-4124-abb0-ec95412d6f74 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:40.990430 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a49bc825-f055-4124-abb0-ec95412d6f74 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:40.992355 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a49bc825-f055-4124-abb0-ec95412d6f74 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:41.375495 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a49bc825-f055-4124-abb0-ec95412d6f74 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:41.385328 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-a49bc825-f055-4124-abb0-ec95412d6f74 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1321 microversion: 2.1 time: 0.420531 Oct 24 08:48:41.385908 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 74/150] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:40 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1321 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:41.582966 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-7bebfea0-dfd3-4429-8086-3281ca430c3b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:41.583762 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-7bebfea0-dfd3-4429-8086-3281ca430c3b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:41.589689 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7bebfea0-dfd3-4429-8086-3281ca430c3b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:41.590324 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7bebfea0-dfd3-4429-8086-3281ca430c3b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:41.590779 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7bebfea0-dfd3-4429-8086-3281ca430c3b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:41.591461 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7bebfea0-dfd3-4429-8086-3281ca430c3b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:41.591904 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7bebfea0-dfd3-4429-8086-3281ca430c3b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:41.592318 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7bebfea0-dfd3-4429-8086-3281ca430c3b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:41.795960 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-7bebfea0-dfd3-4429-8086-3281ca430c3b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:41.804999 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-7bebfea0-dfd3-4429-8086-3281ca430c3b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:41.806932 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-7bebfea0-dfd3-4429-8086-3281ca430c3b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:41.808345 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-7bebfea0-dfd3-4429-8086-3281ca430c3b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1406 microversion: 2.20 time: 0.229262 Oct 24 08:48:41.809470 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 77/151] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:48:41 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:48:41.845790 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-8c8b506c-cd71-4d37-abc2-245c33b3fb30 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:41.847452 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-8c8b506c-cd71-4d37-abc2-245c33b3fb30 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:41.863970 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8c8b506c-cd71-4d37-abc2-245c33b3fb30 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:41.864820 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8c8b506c-cd71-4d37-abc2-245c33b3fb30 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:41.865438 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8c8b506c-cd71-4d37-abc2-245c33b3fb30 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:41.866834 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8c8b506c-cd71-4d37-abc2-245c33b3fb30 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:41.867638 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8c8b506c-cd71-4d37-abc2-245c33b3fb30 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:41.868229 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8c8b506c-cd71-4d37-abc2-245c33b3fb30 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:41.894601 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell1:SELECT=100 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:48:42.150366 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-8c8b506c-cd71-4d37-abc2-245c33b3fb30 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:42.159165 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-8c8b506c-cd71-4d37-abc2-245c33b3fb30 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1" status: 200 len: 1368 microversion: 2.1 time: 0.318465 Oct 24 08:48:42.159763 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 75/152] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:41 2022] GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 => generated 1368 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:42.411983 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-00ec3da1-3f13-4648-9beb-ae0be685ecdf tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:42.413453 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-00ec3da1-3f13-4648-9beb-ae0be685ecdf tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:42.423714 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-00ec3da1-3f13-4648-9beb-ae0be685ecdf tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:42.424671 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-00ec3da1-3f13-4648-9beb-ae0be685ecdf tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:42.425431 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-00ec3da1-3f13-4648-9beb-ae0be685ecdf tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:42.426456 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-00ec3da1-3f13-4648-9beb-ae0be685ecdf tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:42.427458 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-00ec3da1-3f13-4648-9beb-ae0be685ecdf tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:42.428427 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-00ec3da1-3f13-4648-9beb-ae0be685ecdf tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:42.596645 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-00ec3da1-3f13-4648-9beb-ae0be685ecdf tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:42.606462 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-00ec3da1-3f13-4648-9beb-ae0be685ecdf tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1321 microversion: 2.1 time: 0.200287 Oct 24 08:48:42.620193 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 78/153] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:42 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:42.835548 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-cf0a9dbe-b21d-4b59-9d7f-6c013bad8dd8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:42.836615 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-cf0a9dbe-b21d-4b59-9d7f-6c013bad8dd8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:42.844556 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cf0a9dbe-b21d-4b59-9d7f-6c013bad8dd8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:42.845330 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cf0a9dbe-b21d-4b59-9d7f-6c013bad8dd8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:42.845907 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cf0a9dbe-b21d-4b59-9d7f-6c013bad8dd8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:42.848398 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cf0a9dbe-b21d-4b59-9d7f-6c013bad8dd8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:42.849078 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cf0a9dbe-b21d-4b59-9d7f-6c013bad8dd8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:42.849871 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cf0a9dbe-b21d-4b59-9d7f-6c013bad8dd8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:42.998724 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-cf0a9dbe-b21d-4b59-9d7f-6c013bad8dd8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:43.009837 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-cf0a9dbe-b21d-4b59-9d7f-6c013bad8dd8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:43.011918 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-cf0a9dbe-b21d-4b59-9d7f-6c013bad8dd8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:43.013322 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-cf0a9dbe-b21d-4b59-9d7f-6c013bad8dd8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1406 microversion: 2.20 time: 0.182544 Oct 24 08:48:43.014094 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 76/154] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:48:42 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:48:43.192415 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-d22dd03f-faee-4fad-9852-d154dee650d1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:43.195237 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-d22dd03f-faee-4fad-9852-d154dee650d1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:43.218839 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d22dd03f-faee-4fad-9852-d154dee650d1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:43.219636 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d22dd03f-faee-4fad-9852-d154dee650d1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:43.221217 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d22dd03f-faee-4fad-9852-d154dee650d1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:43.222902 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d22dd03f-faee-4fad-9852-d154dee650d1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:43.223357 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d22dd03f-faee-4fad-9852-d154dee650d1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:43.223775 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d22dd03f-faee-4fad-9852-d154dee650d1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:43.408066 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-d22dd03f-faee-4fad-9852-d154dee650d1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:43.420552 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-d22dd03f-faee-4fad-9852-d154dee650d1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1" status: 200 len: 1368 microversion: 2.1 time: 0.241892 Oct 24 08:48:43.434809 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 79/155] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:43 2022] GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 => generated 1368 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:43.594151 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-d9980668-20eb-4230-b566-aee206e78068 req-ea941a73-33f2-46ac-b8ab-5567f079dba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca02e6b0-1ae6-407d-b554-7f96d1aa1726", "name": "network-vif-plugged", "status": "completed", "tag": "251f4f85-a3d9-4ade-80a5-bbb88e814476"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:48:43.614753 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-d9980668-20eb-4230-b566-aee206e78068 req-ea941a73-33f2-46ac-b8ab-5567f079dba4 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:43.620750 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-d9980668-20eb-4230-b566-aee206e78068 req-ea941a73-33f2-46ac-b8ab-5567f079dba4 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:43.621508 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-d9980668-20eb-4230-b566-aee206e78068 req-ea941a73-33f2-46ac-b8ab-5567f079dba4 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:43.632513 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-6a24debb-a983-4d8e-8da5-7a101c08d6cb tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:43.633691 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-6a24debb-a983-4d8e-8da5-7a101c08d6cb tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:43.649823 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6a24debb-a983-4d8e-8da5-7a101c08d6cb tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:43.654904 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6a24debb-a983-4d8e-8da5-7a101c08d6cb tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:43.655643 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6a24debb-a983-4d8e-8da5-7a101c08d6cb tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:43.657362 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6a24debb-a983-4d8e-8da5-7a101c08d6cb tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:43.661946 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6a24debb-a983-4d8e-8da5-7a101c08d6cb tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:43.663278 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6a24debb-a983-4d8e-8da5-7a101c08d6cb tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:43.676278 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-d9980668-20eb-4230-b566-aee206e78068 req-ea941a73-33f2-46ac-b8ab-5567f079dba4 service nova] Creating event network-vif-plugged:251f4f85-a3d9-4ade-80a5-bbb88e814476 for instance ca02e6b0-1ae6-407d-b554-7f96d1aa1726 on hv-cinder-maste Oct 24 08:48:43.696226 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-d9980668-20eb-4230-b566-aee206e78068 req-ea941a73-33f2-46ac-b8ab-5567f079dba4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105807 Oct 24 08:48:43.703629 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 77/156] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:48:43.866765 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-6a24debb-a983-4d8e-8da5-7a101c08d6cb tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:43.876362 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-6a24debb-a983-4d8e-8da5-7a101c08d6cb tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1321 microversion: 2.1 time: 0.248816 Oct 24 08:48:43.877666 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 80/157] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:43 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:48:44.039780 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-8b37cac0-8745-40a1-9538-3b41175f50ca tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:44.040808 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-8b37cac0-8745-40a1-9538-3b41175f50ca tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:44.047634 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8b37cac0-8745-40a1-9538-3b41175f50ca tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:44.048111 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8b37cac0-8745-40a1-9538-3b41175f50ca tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:44.048531 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8b37cac0-8745-40a1-9538-3b41175f50ca tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:44.049202 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8b37cac0-8745-40a1-9538-3b41175f50ca tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:44.049642 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8b37cac0-8745-40a1-9538-3b41175f50ca tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:44.050050 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8b37cac0-8745-40a1-9538-3b41175f50ca tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:44.197755 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-8b37cac0-8745-40a1-9538-3b41175f50ca tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:44.207882 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-8b37cac0-8745-40a1-9538-3b41175f50ca tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:44.217442 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-8b37cac0-8745-40a1-9538-3b41175f50ca tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:44.218706 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-8b37cac0-8745-40a1-9538-3b41175f50ca tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1406 microversion: 2.20 time: 0.184063 Oct 24 08:48:44.219541 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 78/158] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:48:44 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:48:44.451331 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-31f63e8b-1385-4d38-a791-988814db54ab tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:44.452134 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-31f63e8b-1385-4d38-a791-988814db54ab tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:44.459775 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-31f63e8b-1385-4d38-a791-988814db54ab tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:44.460617 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-31f63e8b-1385-4d38-a791-988814db54ab tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:44.461239 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-31f63e8b-1385-4d38-a791-988814db54ab tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:44.462099 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-31f63e8b-1385-4d38-a791-988814db54ab tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:44.462935 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-31f63e8b-1385-4d38-a791-988814db54ab tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:44.463689 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-31f63e8b-1385-4d38-a791-988814db54ab tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:44.612170 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-31f63e8b-1385-4d38-a791-988814db54ab tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:44.629065 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-31f63e8b-1385-4d38-a791-988814db54ab tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1" status: 200 len: 1559 microversion: 2.1 time: 0.182027 Oct 24 08:48:44.629678 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 81/159] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:44 2022] GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:44.652744 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-ce1b7344-5cfb-40d2-b374-b56dff68f708 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:44.653545 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-ce1b7344-5cfb-40d2-b374-b56dff68f708 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:44.661943 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ce1b7344-5cfb-40d2-b374-b56dff68f708 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:44.664290 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ce1b7344-5cfb-40d2-b374-b56dff68f708 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:44.667037 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ce1b7344-5cfb-40d2-b374-b56dff68f708 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:44.667778 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ce1b7344-5cfb-40d2-b374-b56dff68f708 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:44.668218 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ce1b7344-5cfb-40d2-b374-b56dff68f708 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:44.668645 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ce1b7344-5cfb-40d2-b374-b56dff68f708 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:44.776568 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-ce1b7344-5cfb-40d2-b374-b56dff68f708 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.128564 Oct 24 08:48:44.777532 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 79/160] 10.222.0.26 () {58 vars in 1275 bytes} [Mon Oct 24 08:48:44 2022] GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1/os-interface => generated 285 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:48:44.908507 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-cc552f6d-15ef-4764-99b8-1c527ee11560 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:44.910278 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-cc552f6d-15ef-4764-99b8-1c527ee11560 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:44.930625 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cc552f6d-15ef-4764-99b8-1c527ee11560 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:44.932262 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cc552f6d-15ef-4764-99b8-1c527ee11560 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:44.932912 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cc552f6d-15ef-4764-99b8-1c527ee11560 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:44.934270 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cc552f6d-15ef-4764-99b8-1c527ee11560 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:44.937926 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cc552f6d-15ef-4764-99b8-1c527ee11560 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:44.938595 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cc552f6d-15ef-4764-99b8-1c527ee11560 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:45.245499 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-c48a6bb8-9c35-42e2-b618-2da58132706b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:45.246150 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-c48a6bb8-9c35-42e2-b618-2da58132706b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:45.265127 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c48a6bb8-9c35-42e2-b618-2da58132706b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:45.265651 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c48a6bb8-9c35-42e2-b618-2da58132706b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:45.268635 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c48a6bb8-9c35-42e2-b618-2da58132706b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:45.271144 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c48a6bb8-9c35-42e2-b618-2da58132706b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:45.273680 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c48a6bb8-9c35-42e2-b618-2da58132706b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:45.278363 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c48a6bb8-9c35-42e2-b618-2da58132706b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:45.643856 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-c48a6bb8-9c35-42e2-b618-2da58132706b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:45.659677 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-c48a6bb8-9c35-42e2-b618-2da58132706b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:45.662961 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-c48a6bb8-9c35-42e2-b618-2da58132706b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:45.664992 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-c48a6bb8-9c35-42e2-b618-2da58132706b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1406 microversion: 2.20 time: 0.423486 Oct 24 08:48:45.668558 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 80/161] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:48:45 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1406 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:48:45.681927 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-7a54f9ad-a89e-4103-a33f-8f9f0233b5ab tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:45.684226 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-7a54f9ad-a89e-4103-a33f-8f9f0233b5ab tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] [instance: 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:45.689836 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-cc552f6d-15ef-4764-99b8-1c527ee11560 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:45.701028 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-cc552f6d-15ef-4764-99b8-1c527ee11560 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1321 microversion: 2.1 time: 0.804119 Oct 24 08:48:45.709649 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7a54f9ad-a89e-4103-a33f-8f9f0233b5ab tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:45.711044 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7a54f9ad-a89e-4103-a33f-8f9f0233b5ab tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:45.711685 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7a54f9ad-a89e-4103-a33f-8f9f0233b5ab tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:45.712692 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7a54f9ad-a89e-4103-a33f-8f9f0233b5ab tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:45.713518 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7a54f9ad-a89e-4103-a33f-8f9f0233b5ab tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:45.714149 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7a54f9ad-a89e-4103-a33f-8f9f0233b5ab tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:45.715397 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 82/162] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:44 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1321 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:45.752993 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-7a54f9ad-a89e-4103-a33f-8f9f0233b5ab tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] [instance: 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb] Going to try to terminate instance {{(pid=125165) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:48:45.791952 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-8a46bccf-5377-4bdd-970f-f658ebff2236 req-bb0dc2b8-ae58-4a88-b0e8-5431718c1948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf8e51c6-99cf-49c6-b25b-89c3c7045e4e", "name": "network-vif-plugged", "status": "completed", "tag": "c7a98c12-528e-4bbb-9ae8-1c8aaf7fbba9"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:48:45.832302 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-8a46bccf-5377-4bdd-970f-f658ebff2236 req-bb0dc2b8-ae58-4a88-b0e8-5431718c1948 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:45.832820 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-8a46bccf-5377-4bdd-970f-f658ebff2236 req-bb0dc2b8-ae58-4a88-b0e8-5431718c1948 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:45.833246 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-8a46bccf-5377-4bdd-970f-f658ebff2236 req-bb0dc2b8-ae58-4a88-b0e8-5431718c1948 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:45.857912 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-8a46bccf-5377-4bdd-970f-f658ebff2236 req-bb0dc2b8-ae58-4a88-b0e8-5431718c1948 service nova] Creating event network-vif-plugged:c7a98c12-528e-4bbb-9ae8-1c8aaf7fbba9 for instance cf8e51c6-99cf-49c6-b25b-89c3c7045e4e on hv-cinder-maste Oct 24 08:48:45.867564 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-8a46bccf-5377-4bdd-970f-f658ebff2236 req-bb0dc2b8-ae58-4a88-b0e8-5431718c1948 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080495 Oct 24 08:48:45.868419 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 83/163] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:48:45.941344 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-7a54f9ad-a89e-4103-a33f-8f9f0233b5ab tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb" status: 204 len: 0 microversion: 2.1 time: 0.269925 Oct 24 08:48:45.941978 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 81/164] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Oct 24 08:48:45 2022] DELETE /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:48:45.950897 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-c8846d62-82a1-4567-b338-e3458c841466 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:45.951655 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-c8846d62-82a1-4567-b338-e3458c841466 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] [instance: 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:45.958216 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c8846d62-82a1-4567-b338-e3458c841466 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:45.958361 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c8846d62-82a1-4567-b338-e3458c841466 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:45.958817 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c8846d62-82a1-4567-b338-e3458c841466 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:45.959517 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c8846d62-82a1-4567-b338-e3458c841466 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:45.959961 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c8846d62-82a1-4567-b338-e3458c841466 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:45.960379 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c8846d62-82a1-4567-b338-e3458c841466 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:46.123784 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-c8846d62-82a1-4567-b338-e3458c841466 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b002748b80db40358571017d6b42ed09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa4a0e9972c4eb1963334ba4ae99a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:46.134328 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-c8846d62-82a1-4567-b338-e3458c841466 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] 10.222.0.26 "GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb" status: 200 len: 1553 microversion: 2.1 time: 0.187579 Oct 24 08:48:46.135060 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 84/165] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:45 2022] GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb => generated 1553 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:46.698740 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-7477809a-afd8-4a26-b321-63fe32cbe31f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:46.700256 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-7477809a-afd8-4a26-b321-63fe32cbe31f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:46.709588 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7477809a-afd8-4a26-b321-63fe32cbe31f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:46.710687 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7477809a-afd8-4a26-b321-63fe32cbe31f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:46.711924 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7477809a-afd8-4a26-b321-63fe32cbe31f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:46.713098 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7477809a-afd8-4a26-b321-63fe32cbe31f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:46.713985 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7477809a-afd8-4a26-b321-63fe32cbe31f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:46.715112 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7477809a-afd8-4a26-b321-63fe32cbe31f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:46.728667 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-438204d6-a0d6-427d-8936-ab3087eb75a4 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:46.730481 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-438204d6-a0d6-427d-8936-ab3087eb75a4 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:46.754308 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-438204d6-a0d6-427d-8936-ab3087eb75a4 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:46.757562 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-438204d6-a0d6-427d-8936-ab3087eb75a4 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:46.758292 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-438204d6-a0d6-427d-8936-ab3087eb75a4 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:46.760946 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-438204d6-a0d6-427d-8936-ab3087eb75a4 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:46.778287 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-438204d6-a0d6-427d-8936-ab3087eb75a4 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:46.778287 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-438204d6-a0d6-427d-8936-ab3087eb75a4 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:47.069638 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-7477809a-afd8-4a26-b321-63fe32cbe31f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:47.078561 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-7477809a-afd8-4a26-b321-63fe32cbe31f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:47.079775 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-7477809a-afd8-4a26-b321-63fe32cbe31f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:47.080997 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-7477809a-afd8-4a26-b321-63fe32cbe31f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1406 microversion: 2.20 time: 0.387059 Oct 24 08:48:47.095960 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 82/166] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:48:46 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1406 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:48:47.109208 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-91f8d1a3-c128-47a8-b635-3b6f8767e56e req-57b5575e-a3ae-487a-8550-ec5d0eed35d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6890641-4753-4fb7-86a4-fb5782b1b5b1", "tag": "20f1d856-5c54-4f99-8f43-55b3a29d8726"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:48:47.127479 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-91f8d1a3-c128-47a8-b635-3b6f8767e56e req-57b5575e-a3ae-487a-8550-ec5d0eed35d9 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:47.128159 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-91f8d1a3-c128-47a8-b635-3b6f8767e56e req-57b5575e-a3ae-487a-8550-ec5d0eed35d9 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:47.128727 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-91f8d1a3-c128-47a8-b635-3b6f8767e56e req-57b5575e-a3ae-487a-8550-ec5d0eed35d9 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:47.143693 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-91f8d1a3-c128-47a8-b635-3b6f8767e56e req-57b5575e-a3ae-487a-8550-ec5d0eed35d9 service nova] Creating event network-changed:20f1d856-5c54-4f99-8f43-55b3a29d8726 for instance f6890641-4753-4fb7-86a4-fb5782b1b5b1 on hv-cinder-maste Oct 24 08:48:47.149617 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-91f8d1a3-c128-47a8-b635-3b6f8767e56e req-57b5575e-a3ae-487a-8550-ec5d0eed35d9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052330 Oct 24 08:48:47.150437 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 83/167] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:48:47.167199 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-438204d6-a0d6-427d-8936-ab3087eb75a4 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:47.169358 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-d49a7673-f233-44db-b4d7-2efdf39e7ec6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:47.170105 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-d49a7673-f233-44db-b4d7-2efdf39e7ec6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] [instance: 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:47.178341 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d49a7673-f233-44db-b4d7-2efdf39e7ec6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:47.178992 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d49a7673-f233-44db-b4d7-2efdf39e7ec6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:47.179307 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-438204d6-a0d6-427d-8936-ab3087eb75a4 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1321 microversion: 2.1 time: 0.457754 Oct 24 08:48:47.179570 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d49a7673-f233-44db-b4d7-2efdf39e7ec6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:47.179893 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 85/168] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:46 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1321 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:47.192214 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d49a7673-f233-44db-b4d7-2efdf39e7ec6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:47.193539 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d49a7673-f233-44db-b4d7-2efdf39e7ec6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:47.194135 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d49a7673-f233-44db-b4d7-2efdf39e7ec6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:47.491313 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-d49a7673-f233-44db-b4d7-2efdf39e7ec6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b002748b80db40358571017d6b42ed09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa4a0e9972c4eb1963334ba4ae99a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:47.500809 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-d49a7673-f233-44db-b4d7-2efdf39e7ec6 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] 10.222.0.26 "GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb" status: 200 len: 1553 microversion: 2.1 time: 0.344040 Oct 24 08:48:47.501350 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 84/169] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:47 2022] GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb => generated 1553 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:48.109323 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-b3adc3b8-a571-43f5-81c8-2168b12be60b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:48.110693 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-b3adc3b8-a571-43f5-81c8-2168b12be60b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:48.118627 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b3adc3b8-a571-43f5-81c8-2168b12be60b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:48.120162 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b3adc3b8-a571-43f5-81c8-2168b12be60b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:48.120967 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b3adc3b8-a571-43f5-81c8-2168b12be60b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:48.122112 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b3adc3b8-a571-43f5-81c8-2168b12be60b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:48.122788 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b3adc3b8-a571-43f5-81c8-2168b12be60b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:48.123563 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b3adc3b8-a571-43f5-81c8-2168b12be60b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:48.142526 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:48:48.201801 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-d1e7f000-395a-4621-9833-332998223893 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:48.202581 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-d1e7f000-395a-4621-9833-332998223893 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:48.224575 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d1e7f000-395a-4621-9833-332998223893 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:48.225624 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d1e7f000-395a-4621-9833-332998223893 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:48.226343 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d1e7f000-395a-4621-9833-332998223893 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:48.227459 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d1e7f000-395a-4621-9833-332998223893 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:48.228205 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d1e7f000-395a-4621-9833-332998223893 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:48.228839 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d1e7f000-395a-4621-9833-332998223893 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:48.549839 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-b3adc3b8-a571-43f5-81c8-2168b12be60b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:48.563837 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-b3adc3b8-a571-43f5-81c8-2168b12be60b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:48.566601 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-b3adc3b8-a571-43f5-81c8-2168b12be60b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:48.568211 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-b3adc3b8-a571-43f5-81c8-2168b12be60b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1406 microversion: 2.20 time: 0.463420 Oct 24 08:48:48.571167 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 86/170] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:48:48 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1406 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:48:48.584730 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-56f40141-d8c3-41d7-a567-b8844441a9d2 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:48.585354 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-56f40141-d8c3-41d7-a567-b8844441a9d2 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] [instance: 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:48.591253 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_api:SELECT=100 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:48:48.592959 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-56f40141-d8c3-41d7-a567-b8844441a9d2 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:48.593597 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-56f40141-d8c3-41d7-a567-b8844441a9d2 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:48.595026 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-56f40141-d8c3-41d7-a567-b8844441a9d2 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:48.595878 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-56f40141-d8c3-41d7-a567-b8844441a9d2 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:48.596500 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-56f40141-d8c3-41d7-a567-b8844441a9d2 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:48.597062 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-56f40141-d8c3-41d7-a567-b8844441a9d2 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:48.732597 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-d1e7f000-395a-4621-9833-332998223893 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:48.746219 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-d1e7f000-395a-4621-9833-332998223893 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1321 microversion: 2.1 time: 0.548188 Oct 24 08:48:48.758110 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 85/171] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:48 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1321 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:49.163005 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-56f40141-d8c3-41d7-a567-b8844441a9d2 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b002748b80db40358571017d6b42ed09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa4a0e9972c4eb1963334ba4ae99a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:49.175675 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-56f40141-d8c3-41d7-a567-b8844441a9d2 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] 10.222.0.26 "GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb" status: 200 len: 1553 microversion: 2.1 time: 0.603084 Oct 24 08:48:49.176327 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 87/172] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:48 2022] GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb => generated 1553 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:49.597629 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-2336f2c2-c149-4028-8715-ad7561908b23 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:49.598315 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-2336f2c2-c149-4028-8715-ad7561908b23 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:49.604552 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2336f2c2-c149-4028-8715-ad7561908b23 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:49.605306 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2336f2c2-c149-4028-8715-ad7561908b23 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:49.605963 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2336f2c2-c149-4028-8715-ad7561908b23 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:49.606893 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2336f2c2-c149-4028-8715-ad7561908b23 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:49.607543 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2336f2c2-c149-4028-8715-ad7561908b23 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:49.608186 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2336f2c2-c149-4028-8715-ad7561908b23 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:49.773882 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-65d18af5-4fda-409e-ae03-7d5236801bcb tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:49.774858 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-65d18af5-4fda-409e-ae03-7d5236801bcb tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:49.781862 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-65d18af5-4fda-409e-ae03-7d5236801bcb tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:49.782549 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-65d18af5-4fda-409e-ae03-7d5236801bcb tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:49.783250 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-65d18af5-4fda-409e-ae03-7d5236801bcb tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:49.784165 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-65d18af5-4fda-409e-ae03-7d5236801bcb tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:49.784802 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-65d18af5-4fda-409e-ae03-7d5236801bcb tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:49.785494 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-65d18af5-4fda-409e-ae03-7d5236801bcb tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:49.884275 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-2336f2c2-c149-4028-8715-ad7561908b23 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:49.900278 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-2336f2c2-c149-4028-8715-ad7561908b23 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:49.903082 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-2336f2c2-c149-4028-8715-ad7561908b23 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:49.904905 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-2336f2c2-c149-4028-8715-ad7561908b23 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1406 microversion: 2.20 time: 0.310948 Oct 24 08:48:49.906301 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 86/173] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:48:49 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1406 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:48:50.046689 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-65d18af5-4fda-409e-ae03-7d5236801bcb tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:50.057258 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-65d18af5-4fda-409e-ae03-7d5236801bcb tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1516 microversion: 2.1 time: 0.287641 Oct 24 08:48:50.058221 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 88/174] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:49 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1516 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:48:50.087697 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-3225521a-91bf-4b73-bcbc-2d7e76244041 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:48:50.091090 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-3225521a-91bf-4b73-bcbc-2d7e76244041 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:50.111705 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3225521a-91bf-4b73-bcbc-2d7e76244041 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:50.112152 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3225521a-91bf-4b73-bcbc-2d7e76244041 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:50.114147 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3225521a-91bf-4b73-bcbc-2d7e76244041 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:50.115432 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3225521a-91bf-4b73-bcbc-2d7e76244041 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:50.116088 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3225521a-91bf-4b73-bcbc-2d7e76244041 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:50.116675 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3225521a-91bf-4b73-bcbc-2d7e76244041 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:50.182067 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.objects.instance [None req-3225521a-91bf-4b73-bcbc-2d7e76244041 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lazy-loading 'flavor' on Instance uuid ca02e6b0-1ae6-407d-b554-7f96d1aa1726 {{(pid=125165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:48:50.203244 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-42a5fb46-db5d-45bc-8585-d7513279c04d tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:50.204094 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-42a5fb46-db5d-45bc-8585-d7513279c04d tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] [instance: 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:50.215042 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-42a5fb46-db5d-45bc-8585-d7513279c04d tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:50.222315 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-42a5fb46-db5d-45bc-8585-d7513279c04d tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:50.223205 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-42a5fb46-db5d-45bc-8585-d7513279c04d tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:50.224183 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-42a5fb46-db5d-45bc-8585-d7513279c04d tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:50.224845 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-42a5fb46-db5d-45bc-8585-d7513279c04d tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:50.225476 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-42a5fb46-db5d-45bc-8585-d7513279c04d tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:50.454818 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-3225521a-91bf-4b73-bcbc-2d7e76244041 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "POST /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726/action" status: 200 len: 32 microversion: 2.1 time: 0.374374 Oct 24 08:48:50.465244 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 87/175] 10.222.0.26 () {60 vars in 1278 bytes} [Mon Oct 24 08:48:50 2022] POST /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726/action => generated 32 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:48:50.471190 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-574acc0f-1fa8-467c-b741-4e8387bd61b2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:50.471886 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-574acc0f-1fa8-467c-b741-4e8387bd61b2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:50.488454 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-574acc0f-1fa8-467c-b741-4e8387bd61b2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:50.489325 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-574acc0f-1fa8-467c-b741-4e8387bd61b2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:50.490010 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-574acc0f-1fa8-467c-b741-4e8387bd61b2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:50.490935 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-574acc0f-1fa8-467c-b741-4e8387bd61b2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:50.491382 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-574acc0f-1fa8-467c-b741-4e8387bd61b2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:50.491800 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-574acc0f-1fa8-467c-b741-4e8387bd61b2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:50.654865 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-42a5fb46-db5d-45bc-8585-d7513279c04d tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b002748b80db40358571017d6b42ed09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa4a0e9972c4eb1963334ba4ae99a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:50.667642 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-42a5fb46-db5d-45bc-8585-d7513279c04d tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] 10.222.0.26 "GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb" status: 200 len: 1553 microversion: 2.1 time: 0.471694 Oct 24 08:48:50.668532 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 89/176] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:50 2022] GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb => generated 1553 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:50.933664 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-31b41ac1-7f2d-4720-8415-255cbe64df34 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:50.934275 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-31b41ac1-7f2d-4720-8415-255cbe64df34 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:50.945660 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-31b41ac1-7f2d-4720-8415-255cbe64df34 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:50.946290 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-31b41ac1-7f2d-4720-8415-255cbe64df34 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:50.946622 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-31b41ac1-7f2d-4720-8415-255cbe64df34 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:50.955777 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-31b41ac1-7f2d-4720-8415-255cbe64df34 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:50.956270 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-31b41ac1-7f2d-4720-8415-255cbe64df34 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:50.956710 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-31b41ac1-7f2d-4720-8415-255cbe64df34 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:50.969259 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-574acc0f-1fa8-467c-b741-4e8387bd61b2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:50.978057 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-574acc0f-1fa8-467c-b741-4e8387bd61b2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.510965 Oct 24 08:48:50.978625 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 88/177] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:50 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:51.383623 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-31b41ac1-7f2d-4720-8415-255cbe64df34 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:51.399232 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-31b41ac1-7f2d-4720-8415-255cbe64df34 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:51.404151 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-31b41ac1-7f2d-4720-8415-255cbe64df34 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:51.405943 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-31b41ac1-7f2d-4720-8415-255cbe64df34 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1406 microversion: 2.20 time: 0.476300 Oct 24 08:48:51.407999 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 90/178] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:48:50 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1406 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:48:51.700544 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-cc416210-a9af-4548-8370-81c846c1f8f7 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:51.701342 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-cc416210-a9af-4548-8370-81c846c1f8f7 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] [instance: 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:51.715829 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cc416210-a9af-4548-8370-81c846c1f8f7 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:51.716570 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cc416210-a9af-4548-8370-81c846c1f8f7 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:51.719079 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cc416210-a9af-4548-8370-81c846c1f8f7 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:51.720180 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cc416210-a9af-4548-8370-81c846c1f8f7 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:51.721084 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cc416210-a9af-4548-8370-81c846c1f8f7 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:51.722450 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cc416210-a9af-4548-8370-81c846c1f8f7 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:51.875298 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-e74f8759-1028-4d34-bddf-424cbebda491 req-a4b36ce2-38e7-4d02-8851-35c79818a377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ca61184-c71a-4d17-bc49-b99f4d5fbbfb", "name": "network-vif-deleted", "tag": "e6fd644c-236f-4c83-9c3a-375d9c0e8e0b"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:48:51.886936 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-e74f8759-1028-4d34-bddf-424cbebda491 req-a4b36ce2-38e7-4d02-8851-35c79818a377 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:51.887685 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-e74f8759-1028-4d34-bddf-424cbebda491 req-a4b36ce2-38e7-4d02-8851-35c79818a377 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:51.888358 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-e74f8759-1028-4d34-bddf-424cbebda491 req-a4b36ce2-38e7-4d02-8851-35c79818a377 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:51.905084 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-e74f8759-1028-4d34-bddf-424cbebda491 req-a4b36ce2-38e7-4d02-8851-35c79818a377 service nova] Creating event network-vif-deleted:e6fd644c-236f-4c83-9c3a-375d9c0e8e0b for instance 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb on hv-cinder-maste Oct 24 08:48:51.913851 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-e74f8759-1028-4d34-bddf-424cbebda491 req-a4b36ce2-38e7-4d02-8851-35c79818a377 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061832 Oct 24 08:48:51.914791 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 91/179] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:48:51.951201 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-cc416210-a9af-4548-8370-81c846c1f8f7 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b002748b80db40358571017d6b42ed09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa4a0e9972c4eb1963334ba4ae99a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:51.961859 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-cc416210-a9af-4548-8370-81c846c1f8f7 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] 10.222.0.26 "GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb" status: 200 len: 1511 microversion: 2.1 time: 0.266514 Oct 24 08:48:51.976640 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 89/180] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:51 2022] GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb => generated 1511 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:52.012587 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-7456bc4b-8eaf-47ea-a840-dda48159eab3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:52.013478 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-7456bc4b-8eaf-47ea-a840-dda48159eab3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:52.026034 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7456bc4b-8eaf-47ea-a840-dda48159eab3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:52.026472 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7456bc4b-8eaf-47ea-a840-dda48159eab3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:52.026988 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7456bc4b-8eaf-47ea-a840-dda48159eab3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:52.027724 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7456bc4b-8eaf-47ea-a840-dda48159eab3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:52.028249 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7456bc4b-8eaf-47ea-a840-dda48159eab3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:52.029371 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7456bc4b-8eaf-47ea-a840-dda48159eab3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:52.332264 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-7456bc4b-8eaf-47ea-a840-dda48159eab3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:52.355786 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-7456bc4b-8eaf-47ea-a840-dda48159eab3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.355846 Oct 24 08:48:52.371184 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 92/181] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:51 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:52.432185 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-12d00554-ef0d-40c6-a282-5660ef256fcd tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:52.433049 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-12d00554-ef0d-40c6-a282-5660ef256fcd tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:52.439809 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-12d00554-ef0d-40c6-a282-5660ef256fcd tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:52.440456 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-12d00554-ef0d-40c6-a282-5660ef256fcd tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:52.441064 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-12d00554-ef0d-40c6-a282-5660ef256fcd tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:52.442132 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-12d00554-ef0d-40c6-a282-5660ef256fcd tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:52.442917 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-12d00554-ef0d-40c6-a282-5660ef256fcd tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:52.443913 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-12d00554-ef0d-40c6-a282-5660ef256fcd tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:52.447659 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:48:52.991563 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-acb8e2b7-ba78-49b0-a603-5f3125138d44 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:52.992831 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-acb8e2b7-ba78-49b0-a603-5f3125138d44 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] [instance: 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:53.004929 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-acb8e2b7-ba78-49b0-a603-5f3125138d44 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:53.005690 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-acb8e2b7-ba78-49b0-a603-5f3125138d44 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:53.006268 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-acb8e2b7-ba78-49b0-a603-5f3125138d44 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:53.007183 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-acb8e2b7-ba78-49b0-a603-5f3125138d44 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:53.007773 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-acb8e2b7-ba78-49b0-a603-5f3125138d44 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:53.008328 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-acb8e2b7-ba78-49b0-a603-5f3125138d44 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:53.153891 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-12d00554-ef0d-40c6-a282-5660ef256fcd tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:53.171154 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-12d00554-ef0d-40c6-a282-5660ef256fcd tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:53.172759 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-12d00554-ef0d-40c6-a282-5660ef256fcd tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:53.178399 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-12d00554-ef0d-40c6-a282-5660ef256fcd tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1406 microversion: 2.20 time: 0.750244 Oct 24 08:48:53.180838 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 90/182] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:48:52 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1406 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:48:53.244557 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-acb8e2b7-ba78-49b0-a603-5f3125138d44 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b002748b80db40358571017d6b42ed09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa4a0e9972c4eb1963334ba4ae99a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:53.253343 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-acb8e2b7-ba78-49b0-a603-5f3125138d44 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] 10.222.0.26 "GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb" status: 200 len: 1345 microversion: 2.1 time: 0.266050 Oct 24 08:48:53.254515 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 93/183] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:52 2022] GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb => generated 1345 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:53.380846 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-579bf268-4bd8-4578-8c7f-48df48150e48 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:53.382361 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-579bf268-4bd8-4578-8c7f-48df48150e48 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:53.391165 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-579bf268-4bd8-4578-8c7f-48df48150e48 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:53.392007 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-579bf268-4bd8-4578-8c7f-48df48150e48 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:53.392601 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-579bf268-4bd8-4578-8c7f-48df48150e48 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:53.394034 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-579bf268-4bd8-4578-8c7f-48df48150e48 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:53.395336 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-579bf268-4bd8-4578-8c7f-48df48150e48 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:53.395336 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-579bf268-4bd8-4578-8c7f-48df48150e48 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:53.803442 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-579bf268-4bd8-4578-8c7f-48df48150e48 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:53.817655 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-579bf268-4bd8-4578-8c7f-48df48150e48 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.443853 Oct 24 08:48:53.818856 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 91/184] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:53 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:54.208410 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-112f58d0-efe9-4cc1-878c-7df06a78955f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:54.209015 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-112f58d0-efe9-4cc1-878c-7df06a78955f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:54.220328 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-112f58d0-efe9-4cc1-878c-7df06a78955f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:54.223354 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-112f58d0-efe9-4cc1-878c-7df06a78955f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:54.224003 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-112f58d0-efe9-4cc1-878c-7df06a78955f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:54.225845 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-112f58d0-efe9-4cc1-878c-7df06a78955f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:54.226457 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-112f58d0-efe9-4cc1-878c-7df06a78955f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:54.226927 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-112f58d0-efe9-4cc1-878c-7df06a78955f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:54.283028 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-aa87760f-67f0-436f-9bc4-dad12f9f9958 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:54.285308 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-aa87760f-67f0-436f-9bc4-dad12f9f9958 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] [instance: 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:54.302308 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-aa87760f-67f0-436f-9bc4-dad12f9f9958 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:54.303162 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-aa87760f-67f0-436f-9bc4-dad12f9f9958 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:54.304259 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-aa87760f-67f0-436f-9bc4-dad12f9f9958 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:54.305491 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-aa87760f-67f0-436f-9bc4-dad12f9f9958 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:54.306148 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-aa87760f-67f0-436f-9bc4-dad12f9f9958 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:54.307483 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-aa87760f-67f0-436f-9bc4-dad12f9f9958 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:54.418839 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-aa87760f-67f0-436f-9bc4-dad12f9f9958 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:54.419655 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-aa87760f-67f0-436f-9bc4-dad12f9f9958 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:54.420117 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-aa87760f-67f0-436f-9bc4-dad12f9f9958 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:54.420594 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.objects.instance [None req-aa87760f-67f0-436f-9bc4-dad12f9f9958 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lazy-loading 'fault' on Instance uuid 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb {{(pid=125165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:48:54.498233 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-aa87760f-67f0-436f-9bc4-dad12f9f9958 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b002748b80db40358571017d6b42ed09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa4a0e9972c4eb1963334ba4ae99a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:54.506785 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-aa87760f-67f0-436f-9bc4-dad12f9f9958 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] 10.222.0.26 "GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb" status: 200 len: 1304 microversion: 2.1 time: 0.230774 Oct 24 08:48:54.509605 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 92/185] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:54 2022] GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb => generated 1304 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:54.758343 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-112f58d0-efe9-4cc1-878c-7df06a78955f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:54.771251 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-112f58d0-efe9-4cc1-878c-7df06a78955f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:54.772677 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-112f58d0-efe9-4cc1-878c-7df06a78955f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:54.773863 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-112f58d0-efe9-4cc1-878c-7df06a78955f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1598 microversion: 2.20 time: 0.569683 Oct 24 08:48:54.786160 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 94/186] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:48:54 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1598 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:48:54.810110 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-e6657f2b-d028-40ad-9f05-81ab9759f679 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:54.813264 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-e6657f2b-d028-40ad-9f05-81ab9759f679 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:54.824274 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e6657f2b-d028-40ad-9f05-81ab9759f679 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:54.824778 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e6657f2b-d028-40ad-9f05-81ab9759f679 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:54.825216 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e6657f2b-d028-40ad-9f05-81ab9759f679 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:54.825915 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e6657f2b-d028-40ad-9f05-81ab9759f679 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:54.826364 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e6657f2b-d028-40ad-9f05-81ab9759f679 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:54.826822 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e6657f2b-d028-40ad-9f05-81ab9759f679 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:54.841945 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-9a2f6878-8550-4a4a-bb7c-1d26fe03bcd2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:54.842743 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-9a2f6878-8550-4a4a-bb7c-1d26fe03bcd2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:54.854966 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9a2f6878-8550-4a4a-bb7c-1d26fe03bcd2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:54.855461 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9a2f6878-8550-4a4a-bb7c-1d26fe03bcd2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:54.855894 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9a2f6878-8550-4a4a-bb7c-1d26fe03bcd2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:54.856593 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9a2f6878-8550-4a4a-bb7c-1d26fe03bcd2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:54.857041 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9a2f6878-8550-4a4a-bb7c-1d26fe03bcd2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:54.857463 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9a2f6878-8550-4a4a-bb7c-1d26fe03bcd2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:55.024102 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-e6657f2b-d028-40ad-9f05-81ab9759f679 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.219915 Oct 24 08:48:55.028237 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 93/187] 10.222.0.26 () {60 vars in 1316 bytes} [Mon Oct 24 08:48:54 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e/os-interface => generated 285 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:48:55.236840 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-9a2f6878-8550-4a4a-bb7c-1d26fe03bcd2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:55.251632 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-9a2f6878-8550-4a4a-bb7c-1d26fe03bcd2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.413855 Oct 24 08:48:55.253866 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 95/188] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:54 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:55.542982 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-07c2c2a2-5a3c-487c-abfa-d066d419bb8c tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:55.543611 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-07c2c2a2-5a3c-487c-abfa-d066d419bb8c tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] [instance: 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:55.553864 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-07c2c2a2-5a3c-487c-abfa-d066d419bb8c tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:55.555281 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-07c2c2a2-5a3c-487c-abfa-d066d419bb8c tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:55.556193 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-07c2c2a2-5a3c-487c-abfa-d066d419bb8c tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:55.557210 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-07c2c2a2-5a3c-487c-abfa-d066d419bb8c tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:55.557863 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-07c2c2a2-5a3c-487c-abfa-d066d419bb8c tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:55.558565 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-07c2c2a2-5a3c-487c-abfa-d066d419bb8c tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:55.769326 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.wsgi [None req-07c2c2a2-5a3c-487c-abfa-d066d419bb8c tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] HTTP exception thrown: Instance 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb could not be found. Oct 24 08:48:55.774297 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-07c2c2a2-5a3c-487c-abfa-d066d419bb8c tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Request method failure captured: Oct 24 08:48:55.774297 dv-cinder-master-3-smb devstack@n-api.service[125165]: request: GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb HTTP/1.1 Oct 24 08:48:55.774297 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept: application/json Oct 24 08:48:55.774297 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept-Encoding: identity Oct 24 08:48:55.774297 dv-cinder-master-3-smb devstack@n-api.service[125165]: Connection: close Oct 24 08:48:55.774297 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Length: 0 Oct 24 08:48:55.774297 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Type: application/json Oct 24 08:48:55.774297 dv-cinder-master-3-smb devstack@n-api.service[125165]: Host: 10.222.0.26 Oct 24 08:48:55.774297 dv-cinder-master-3-smb devstack@n-api.service[125165]: Openstack-System-Scope: None Oct 24 08:48:55.774297 dv-cinder-master-3-smb devstack@n-api.service[125165]: User-Agent: python-urllib3/1.26.12 Oct 24 08:48:55.774297 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Auth-Token: gAAAAABjVlE5IP6pE7JKK_yINZGTWjuArzLmNfMes6KsLOSTyn51OtkmdEL22rhUTDcSg7ogycP1TRLcY4fVYU2lB-w0tQ11tkABoN1Fe_5tXuMXLa1FqCBDUdcvvD6fupaiLbX26_dTGKAL86rP8SmZ4S_3GJphkpY81J-qw9jyZRB10Y8f1sY Oct 24 08:48:55.774297 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Id: None Oct 24 08:48:55.774297 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Name: None Oct 24 08:48:55.774297 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Identity-Status: Confirmed Oct 24 08:48:55.774297 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Is-Admin-Project: True Oct 24 08:48:55.774297 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Id: default Oct 24 08:48:55.774297 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Name: Default Oct 24 08:48:55.774297 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Id: 7fa4a0e9972c4eb1963334ba4ae99a4f Oct 24 08:48:55.774297 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Name: tempest-DeleteServersTestJSON-807492401 Oct 24 08:48:55.774297 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Role: reader,member Oct 24 08:48:55.774297 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Roles: reader,member Oct 24 08:48:55.775853 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7fa4a0e9972c4eb1963334ba4ae99a4f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7fa4a0e9972c4eb1963334ba4ae99a4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7fa4a0e9972c4eb1963334ba4ae99a4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7fa4a0e9972c4eb1963334ba4ae99a4f"}]}] Oct 24 08:48:55.775853 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant: tempest-DeleteServersTestJSON-807492401 Oct 24 08:48:55.775853 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Id: 7fa4a0e9972c4eb1963334ba4ae99a4f Oct 24 08:48:55.775853 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Name: tempest-DeleteServersTestJSON-807492401 Oct 24 08:48:55.775853 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User: tempest-DeleteServersTestJSON-807492401-project Oct 24 08:48:55.775853 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Id: default Oct 24 08:48:55.775853 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Name: Default Oct 24 08:48:55.775853 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Id: b002748b80db40358571017d6b42ed09 Oct 24 08:48:55.775853 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Name: tempest-DeleteServersTestJSON-807492401-project Oct 24 08:48:55.775853 dv-cinder-master-3-smb devstack@n-api.service[125165]: method: > Oct 24 08:48:55.775853 dv-cinder-master-3-smb devstack@n-api.service[125165]: exception: Instance 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb could not be found. Oct 24 08:48:55.775853 dv-cinder-master-3-smb devstack@n-api.service[125165]: action_args: {'id': '3ca61184-c71a-4d17-bc49-b99f4d5fbbfb'} Oct 24 08:48:55.776638 dv-cinder-master-3-smb devstack@n-api.service[125165]: {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:48:55.776638 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:48:55.776638 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:48:55.776638 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:48:55.776638 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:48:55.776638 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:48:55.776638 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:48:55.776638 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:48:55.776638 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:48:55.776638 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:48:55.776638 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb could not be found. Oct 24 08:48:55.776638 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:48:55.776638 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:48:55.776638 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:48:55.776638 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:48:55.776638 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:48:55.776638 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:48:55.776638 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:48:55.776638 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:48:55.776638 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:48:55.777703 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:48:55.777703 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:48:55.777703 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:48:55.777703 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:48:55.777703 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:48:55.777703 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:48:55.777703 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:48:55.777703 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb could not be found. Oct 24 08:48:55.777703 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:48:55.777703 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:48:55.777703 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:48:55.777703 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:48:55.777703 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:48:55.777703 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:48:55.777703 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:48:55.777703 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:48:55.777703 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb could not be found. Oct 24 08:48:55.777703 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:48:55.778671 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-07c2c2a2-5a3c-487c-abfa-d066d419bb8c tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Returning 404 to user: Instance 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb could not be found. {{(pid=125165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:48:55.778671 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-07c2c2a2-5a3c-487c-abfa-d066d419bb8c tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] 10.222.0.26 "GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb" status: 404 len: 111 microversion: 2.1 time: 0.243056 Oct 24 08:48:55.778671 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 94/189] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:55 2022] GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb => generated 111 bytes in 244 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 08:48:55.954247 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-c119fdea-3814-449b-8960-631d8fbfed02 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:55.959016 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-c119fdea-3814-449b-8960-631d8fbfed02 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] [instance: 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:55.974068 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c119fdea-3814-449b-8960-631d8fbfed02 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:55.975681 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c119fdea-3814-449b-8960-631d8fbfed02 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:55.977438 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c119fdea-3814-449b-8960-631d8fbfed02 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:55.980679 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c119fdea-3814-449b-8960-631d8fbfed02 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:55.981386 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c119fdea-3814-449b-8960-631d8fbfed02 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:55.982016 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c119fdea-3814-449b-8960-631d8fbfed02 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:56.018981 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.wsgi [None req-c119fdea-3814-449b-8960-631d8fbfed02 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] HTTP exception thrown: Instance 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb could not be found. Oct 24 08:48:56.041031 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-c119fdea-3814-449b-8960-631d8fbfed02 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Request method failure captured: Oct 24 08:48:56.041031 dv-cinder-master-3-smb devstack@n-api.service[125164]: request: GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb/os-volume_attachments HTTP/1.1 Oct 24 08:48:56.041031 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept: application/json Oct 24 08:48:56.041031 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept-Encoding: identity Oct 24 08:48:56.041031 dv-cinder-master-3-smb devstack@n-api.service[125164]: Connection: close Oct 24 08:48:56.041031 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Length: 0 Oct 24 08:48:56.041031 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Type: application/json Oct 24 08:48:56.041031 dv-cinder-master-3-smb devstack@n-api.service[125164]: Host: 10.222.0.26 Oct 24 08:48:56.041031 dv-cinder-master-3-smb devstack@n-api.service[125164]: Openstack-System-Scope: None Oct 24 08:48:56.041031 dv-cinder-master-3-smb devstack@n-api.service[125164]: User-Agent: python-urllib3/1.26.12 Oct 24 08:48:56.041031 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Auth-Token: gAAAAABjVlE5IP6pE7JKK_yINZGTWjuArzLmNfMes6KsLOSTyn51OtkmdEL22rhUTDcSg7ogycP1TRLcY4fVYU2lB-w0tQ11tkABoN1Fe_5tXuMXLa1FqCBDUdcvvD6fupaiLbX26_dTGKAL86rP8SmZ4S_3GJphkpY81J-qw9jyZRB10Y8f1sY Oct 24 08:48:56.041031 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Id: None Oct 24 08:48:56.041031 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Name: None Oct 24 08:48:56.041031 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Identity-Status: Confirmed Oct 24 08:48:56.041031 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Is-Admin-Project: True Oct 24 08:48:56.041031 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Id: default Oct 24 08:48:56.041031 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Name: Default Oct 24 08:48:56.041031 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Id: 7fa4a0e9972c4eb1963334ba4ae99a4f Oct 24 08:48:56.041031 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Name: tempest-DeleteServersTestJSON-807492401 Oct 24 08:48:56.041031 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Role: reader,member Oct 24 08:48:56.041031 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Roles: reader,member Oct 24 08:48:56.042323 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7fa4a0e9972c4eb1963334ba4ae99a4f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7fa4a0e9972c4eb1963334ba4ae99a4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7fa4a0e9972c4eb1963334ba4ae99a4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7fa4a0e9972c4eb1963334ba4ae99a4f"}]}] Oct 24 08:48:56.042323 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant: tempest-DeleteServersTestJSON-807492401 Oct 24 08:48:56.042323 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Id: 7fa4a0e9972c4eb1963334ba4ae99a4f Oct 24 08:48:56.042323 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Name: tempest-DeleteServersTestJSON-807492401 Oct 24 08:48:56.042323 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User: tempest-DeleteServersTestJSON-807492401-project Oct 24 08:48:56.042323 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Id: default Oct 24 08:48:56.042323 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Name: Default Oct 24 08:48:56.042323 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Id: b002748b80db40358571017d6b42ed09 Oct 24 08:48:56.042323 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Name: tempest-DeleteServersTestJSON-807492401-project Oct 24 08:48:56.042323 dv-cinder-master-3-smb devstack@n-api.service[125164]: method: > Oct 24 08:48:56.042323 dv-cinder-master-3-smb devstack@n-api.service[125164]: exception: Instance 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb could not be found. Oct 24 08:48:56.042323 dv-cinder-master-3-smb devstack@n-api.service[125164]: action_args: {'server_id': '3ca61184-c71a-4d17-bc49-b99f4d5fbbfb'} Oct 24 08:48:56.043419 dv-cinder-master-3-smb devstack@n-api.service[125164]: {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:48:56.043419 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:48:56.043419 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:48:56.043419 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:48:56.043419 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:48:56.043419 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:48:56.043419 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:48:56.043419 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:48:56.043419 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:48:56.043419 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:48:56.043419 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb could not be found. Oct 24 08:48:56.043419 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:48:56.043419 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:48:56.043419 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:48:56.043419 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:48:56.043419 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:48:56.043419 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:48:56.043419 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:48:56.043419 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:48:56.043419 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:48:56.044478 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:48:56.044478 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 08:48:56.044478 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:48:56.044478 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 08:48:56.044478 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:48:56.044478 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 24 08:48:56.044478 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 24 08:48:56.044478 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:48:56.044478 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:48:56.044478 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb could not be found. Oct 24 08:48:56.044478 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:48:56.044478 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:48:56.044478 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:48:56.044478 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:48:56.044478 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:48:56.044478 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:48:56.044478 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:48:56.044478 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:48:56.044478 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb could not be found. Oct 24 08:48:56.044478 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:48:56.051008 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-c119fdea-3814-449b-8960-631d8fbfed02 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Returning 404 to user: Instance 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb could not be found. {{(pid=125164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:48:56.052064 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-c119fdea-3814-449b-8960-631d8fbfed02 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] 10.222.0.26 "GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.103657 Oct 24 08:48:56.053036 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 96/190] 10.222.0.26 () {58 vars in 1302 bytes} [Mon Oct 24 08:48:55 2022] GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb/os-volume_attachments => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:48:56.096241 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-dc283366-64d6-4d7e-809f-5ff7a7502eba tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1913498870", "imageRef": "7eef2d62-12dc-4746-9cbd-870797d39b4d", "flavorRef": "452", "networks": [{"uuid": "b33af980-7b23-473d-8c46-12025d6a0862"}]}} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:48:56.188351 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.network.neutron [None req-dc283366-64d6-4d7e-809f-5ff7a7502eba tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] validate_networks() for [('b33af980-7b23-473d-8c46-12025d6a0862', None, None, None, None, None)] {{(pid=125165) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:48:56.277538 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-04e244a5-6afd-4fb0-824a-fa8742edd865 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:56.278308 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-04e244a5-6afd-4fb0-824a-fa8742edd865 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:56.301310 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-04e244a5-6afd-4fb0-824a-fa8742edd865 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:56.302946 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-04e244a5-6afd-4fb0-824a-fa8742edd865 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:56.303662 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-04e244a5-6afd-4fb0-824a-fa8742edd865 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:56.305974 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-04e244a5-6afd-4fb0-824a-fa8742edd865 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:56.307606 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-04e244a5-6afd-4fb0-824a-fa8742edd865 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:56.310747 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-04e244a5-6afd-4fb0-824a-fa8742edd865 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:56.803750 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-04e244a5-6afd-4fb0-824a-fa8742edd865 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:56.817832 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-04e244a5-6afd-4fb0-824a-fa8742edd865 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.544507 Oct 24 08:48:56.822747 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 97/191] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:56 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:57.480924 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-03214f6a-6ce7-4b38-89e6-889101a2a07b req-0332d92f-38dd-4d2f-968a-07c1eef59e44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf8e51c6-99cf-49c6-b25b-89c3c7045e4e", "tag": "c7a98c12-528e-4bbb-9ae8-1c8aaf7fbba9"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:48:57.516912 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-03214f6a-6ce7-4b38-89e6-889101a2a07b req-0332d92f-38dd-4d2f-968a-07c1eef59e44 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:57.521681 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-03214f6a-6ce7-4b38-89e6-889101a2a07b req-0332d92f-38dd-4d2f-968a-07c1eef59e44 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:57.524296 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-03214f6a-6ce7-4b38-89e6-889101a2a07b req-0332d92f-38dd-4d2f-968a-07c1eef59e44 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:57.556451 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-03214f6a-6ce7-4b38-89e6-889101a2a07b req-0332d92f-38dd-4d2f-968a-07c1eef59e44 service nova] Creating event network-changed:c7a98c12-528e-4bbb-9ae8-1c8aaf7fbba9 for instance cf8e51c6-99cf-49c6-b25b-89c3c7045e4e on hv-cinder-maste Oct 24 08:48:57.571860 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-03214f6a-6ce7-4b38-89e6-889101a2a07b req-0332d92f-38dd-4d2f-968a-07c1eef59e44 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093073 Oct 24 08:48:57.576415 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 98/192] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:48:57.590841 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-55d05c5e-e7a3-4a48-a7f8-bd17c4906545 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:57.592916 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-55d05c5e-e7a3-4a48-a7f8-bd17c4906545 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] [instance: 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:57.612261 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-55d05c5e-e7a3-4a48-a7f8-bd17c4906545 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:57.613513 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-55d05c5e-e7a3-4a48-a7f8-bd17c4906545 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:57.614332 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-55d05c5e-e7a3-4a48-a7f8-bd17c4906545 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:57.615106 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-55d05c5e-e7a3-4a48-a7f8-bd17c4906545 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:57.615561 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-55d05c5e-e7a3-4a48-a7f8-bd17c4906545 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:57.620998 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-55d05c5e-e7a3-4a48-a7f8-bd17c4906545 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:57.660121 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.wsgi [None req-55d05c5e-e7a3-4a48-a7f8-bd17c4906545 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] HTTP exception thrown: Instance 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb could not be found. Oct 24 08:48:57.668806 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-55d05c5e-e7a3-4a48-a7f8-bd17c4906545 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Request method failure captured: Oct 24 08:48:57.668806 dv-cinder-master-3-smb devstack@n-api.service[125164]: request: DELETE /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb HTTP/1.1 Oct 24 08:48:57.668806 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept: application/json Oct 24 08:48:57.668806 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept-Encoding: identity Oct 24 08:48:57.668806 dv-cinder-master-3-smb devstack@n-api.service[125164]: Connection: close Oct 24 08:48:57.668806 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Length: 0 Oct 24 08:48:57.668806 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Type: application/json Oct 24 08:48:57.668806 dv-cinder-master-3-smb devstack@n-api.service[125164]: Host: 10.222.0.26 Oct 24 08:48:57.668806 dv-cinder-master-3-smb devstack@n-api.service[125164]: Openstack-System-Scope: None Oct 24 08:48:57.668806 dv-cinder-master-3-smb devstack@n-api.service[125164]: User-Agent: python-urllib3/1.26.12 Oct 24 08:48:57.668806 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Auth-Token: gAAAAABjVlE5IP6pE7JKK_yINZGTWjuArzLmNfMes6KsLOSTyn51OtkmdEL22rhUTDcSg7ogycP1TRLcY4fVYU2lB-w0tQ11tkABoN1Fe_5tXuMXLa1FqCBDUdcvvD6fupaiLbX26_dTGKAL86rP8SmZ4S_3GJphkpY81J-qw9jyZRB10Y8f1sY Oct 24 08:48:57.668806 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Id: None Oct 24 08:48:57.668806 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Name: None Oct 24 08:48:57.668806 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Identity-Status: Confirmed Oct 24 08:48:57.668806 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Is-Admin-Project: True Oct 24 08:48:57.668806 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Id: default Oct 24 08:48:57.668806 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Name: Default Oct 24 08:48:57.668806 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Id: 7fa4a0e9972c4eb1963334ba4ae99a4f Oct 24 08:48:57.668806 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Name: tempest-DeleteServersTestJSON-807492401 Oct 24 08:48:57.668806 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Role: reader,member Oct 24 08:48:57.668806 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Roles: reader,member Oct 24 08:48:57.670417 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7fa4a0e9972c4eb1963334ba4ae99a4f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7fa4a0e9972c4eb1963334ba4ae99a4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7fa4a0e9972c4eb1963334ba4ae99a4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7fa4a0e9972c4eb1963334ba4ae99a4f"}]}] Oct 24 08:48:57.670417 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant: tempest-DeleteServersTestJSON-807492401 Oct 24 08:48:57.670417 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Id: 7fa4a0e9972c4eb1963334ba4ae99a4f Oct 24 08:48:57.670417 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Name: tempest-DeleteServersTestJSON-807492401 Oct 24 08:48:57.670417 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User: tempest-DeleteServersTestJSON-807492401-project Oct 24 08:48:57.670417 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Id: default Oct 24 08:48:57.670417 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Name: Default Oct 24 08:48:57.670417 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Id: b002748b80db40358571017d6b42ed09 Oct 24 08:48:57.670417 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Name: tempest-DeleteServersTestJSON-807492401-project Oct 24 08:48:57.670417 dv-cinder-master-3-smb devstack@n-api.service[125164]: method: > Oct 24 08:48:57.670417 dv-cinder-master-3-smb devstack@n-api.service[125164]: exception: Instance 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb could not be found. Oct 24 08:48:57.670417 dv-cinder-master-3-smb devstack@n-api.service[125164]: action_args: {'id': '3ca61184-c71a-4d17-bc49-b99f4d5fbbfb'} Oct 24 08:48:57.671546 dv-cinder-master-3-smb devstack@n-api.service[125164]: {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:48:57.671546 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:48:57.671546 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:48:57.671546 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:48:57.671546 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:48:57.671546 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:48:57.671546 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:48:57.671546 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:48:57.671546 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:48:57.671546 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:48:57.671546 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb could not be found. Oct 24 08:48:57.671546 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:48:57.671546 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:48:57.671546 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:48:57.671546 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:48:57.671546 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:48:57.671546 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:48:57.671546 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:48:57.671546 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:48:57.671546 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:48:57.672786 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:48:57.672786 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 08:48:57.672786 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 08:48:57.672786 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 08:48:57.672786 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 08:48:57.672786 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:48:57.672786 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:48:57.672786 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:48:57.672786 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:48:57.672786 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb could not be found. Oct 24 08:48:57.672786 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:48:57.672786 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:48:57.672786 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:48:57.672786 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:48:57.672786 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:48:57.672786 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:48:57.672786 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:48:57.672786 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:48:57.672786 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb could not be found. Oct 24 08:48:57.672786 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:48:57.673889 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-55d05c5e-e7a3-4a48-a7f8-bd17c4906545 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Returning 404 to user: Instance 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb could not be found. {{(pid=125164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:48:57.673889 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-55d05c5e-e7a3-4a48-a7f8-bd17c4906545 tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb" status: 404 len: 111 microversion: 2.1 time: 0.092815 Oct 24 08:48:57.675029 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 99/193] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Oct 24 08:48:57 2022] DELETE /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:48:57.690959 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-bdd9fe09-e287-4ac7-b03f-0b82e13cb52c tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:57.694348 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-bdd9fe09-e287-4ac7-b03f-0b82e13cb52c tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] [instance: 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:57.710621 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bdd9fe09-e287-4ac7-b03f-0b82e13cb52c tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:57.711147 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bdd9fe09-e287-4ac7-b03f-0b82e13cb52c tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:57.711578 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bdd9fe09-e287-4ac7-b03f-0b82e13cb52c tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:57.712285 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bdd9fe09-e287-4ac7-b03f-0b82e13cb52c tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:57.712734 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bdd9fe09-e287-4ac7-b03f-0b82e13cb52c tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:57.713157 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bdd9fe09-e287-4ac7-b03f-0b82e13cb52c tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:57.769589 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.wsgi [None req-bdd9fe09-e287-4ac7-b03f-0b82e13cb52c tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] HTTP exception thrown: Instance 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb could not be found. Oct 24 08:48:57.771254 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-bdd9fe09-e287-4ac7-b03f-0b82e13cb52c tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Request method failure captured: Oct 24 08:48:57.771254 dv-cinder-master-3-smb devstack@n-api.service[125164]: request: GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb HTTP/1.1 Oct 24 08:48:57.771254 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept: application/json Oct 24 08:48:57.771254 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept-Encoding: identity Oct 24 08:48:57.771254 dv-cinder-master-3-smb devstack@n-api.service[125164]: Connection: close Oct 24 08:48:57.771254 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Length: 0 Oct 24 08:48:57.771254 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Type: application/json Oct 24 08:48:57.771254 dv-cinder-master-3-smb devstack@n-api.service[125164]: Host: 10.222.0.26 Oct 24 08:48:57.771254 dv-cinder-master-3-smb devstack@n-api.service[125164]: Openstack-System-Scope: None Oct 24 08:48:57.771254 dv-cinder-master-3-smb devstack@n-api.service[125164]: User-Agent: python-urllib3/1.26.12 Oct 24 08:48:57.771254 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Auth-Token: gAAAAABjVlE5IP6pE7JKK_yINZGTWjuArzLmNfMes6KsLOSTyn51OtkmdEL22rhUTDcSg7ogycP1TRLcY4fVYU2lB-w0tQ11tkABoN1Fe_5tXuMXLa1FqCBDUdcvvD6fupaiLbX26_dTGKAL86rP8SmZ4S_3GJphkpY81J-qw9jyZRB10Y8f1sY Oct 24 08:48:57.771254 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Id: None Oct 24 08:48:57.771254 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Name: None Oct 24 08:48:57.771254 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Identity-Status: Confirmed Oct 24 08:48:57.771254 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Is-Admin-Project: True Oct 24 08:48:57.771254 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Id: default Oct 24 08:48:57.771254 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Name: Default Oct 24 08:48:57.771254 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Id: 7fa4a0e9972c4eb1963334ba4ae99a4f Oct 24 08:48:57.771254 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Name: tempest-DeleteServersTestJSON-807492401 Oct 24 08:48:57.771254 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Role: reader,member Oct 24 08:48:57.771254 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Roles: reader,member Oct 24 08:48:57.772578 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7fa4a0e9972c4eb1963334ba4ae99a4f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7fa4a0e9972c4eb1963334ba4ae99a4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7fa4a0e9972c4eb1963334ba4ae99a4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7fa4a0e9972c4eb1963334ba4ae99a4f"}]}] Oct 24 08:48:57.772578 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant: tempest-DeleteServersTestJSON-807492401 Oct 24 08:48:57.772578 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Id: 7fa4a0e9972c4eb1963334ba4ae99a4f Oct 24 08:48:57.772578 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Name: tempest-DeleteServersTestJSON-807492401 Oct 24 08:48:57.772578 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User: tempest-DeleteServersTestJSON-807492401-project Oct 24 08:48:57.772578 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Id: default Oct 24 08:48:57.772578 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Name: Default Oct 24 08:48:57.772578 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Id: b002748b80db40358571017d6b42ed09 Oct 24 08:48:57.772578 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Name: tempest-DeleteServersTestJSON-807492401-project Oct 24 08:48:57.772578 dv-cinder-master-3-smb devstack@n-api.service[125164]: method: > Oct 24 08:48:57.772578 dv-cinder-master-3-smb devstack@n-api.service[125164]: exception: Instance 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb could not be found. Oct 24 08:48:57.772578 dv-cinder-master-3-smb devstack@n-api.service[125164]: action_args: {'id': '3ca61184-c71a-4d17-bc49-b99f4d5fbbfb'} Oct 24 08:48:57.773230 dv-cinder-master-3-smb devstack@n-api.service[125164]: {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:48:57.773230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:48:57.773230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:48:57.773230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:48:57.773230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:48:57.773230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:48:57.773230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:48:57.773230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:48:57.773230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:48:57.773230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:48:57.773230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb could not be found. Oct 24 08:48:57.773230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:48:57.773230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:48:57.773230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:48:57.773230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:48:57.773230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:48:57.773230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:48:57.773230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:48:57.773230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:48:57.773230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:48:57.774897 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:48:57.774897 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:48:57.774897 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:48:57.774897 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:48:57.774897 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:48:57.774897 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:48:57.774897 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:48:57.774897 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb could not be found. Oct 24 08:48:57.774897 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:48:57.774897 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:48:57.774897 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:48:57.774897 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:48:57.774897 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:48:57.774897 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:48:57.774897 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:48:57.774897 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:48:57.774897 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb could not be found. Oct 24 08:48:57.774897 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:48:57.775886 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-bdd9fe09-e287-4ac7-b03f-0b82e13cb52c tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] Returning 404 to user: Instance 3ca61184-c71a-4d17-bc49-b99f4d5fbbfb could not be found. {{(pid=125164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:48:57.775886 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-bdd9fe09-e287-4ac7-b03f-0b82e13cb52c tempest-DeleteServersTestJSON-807492401 tempest-DeleteServersTestJSON-807492401-project] 10.222.0.26 "GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb" status: 404 len: 111 microversion: 2.1 time: 0.096058 Oct 24 08:48:57.786583 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 100/194] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:57 2022] GET /compute/v2.1/servers/3ca61184-c71a-4d17-bc49-b99f4d5fbbfb => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:48:57.812376 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-dc283366-64d6-4d7e-809f-5ff7a7502eba tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Flavor limits 0:0:0 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:48:57.813636 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-dc283366-64d6-4d7e-809f-5ff7a7502eba tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Image limits 0:0:0 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:48:57.814250 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-dc283366-64d6-4d7e-809f-5ff7a7502eba tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Flavor pref 0:0:0 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:48:57.815440 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-dc283366-64d6-4d7e-809f-5ff7a7502eba tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Image pref 0:0:0 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:48:57.816336 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-dc283366-64d6-4d7e-809f-5ff7a7502eba tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:48:57.843212 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-dc283366-64d6-4d7e-809f-5ff7a7502eba tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:57.844120 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-efaf9c19-b20b-4915-a93c-c6992504b958 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:57.844448 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-dc283366-64d6-4d7e-809f-5ff7a7502eba tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:57.844883 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-efaf9c19-b20b-4915-a93c-c6992504b958 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:57.845694 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-dc283366-64d6-4d7e-809f-5ff7a7502eba tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:57.846705 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-dc283366-64d6-4d7e-809f-5ff7a7502eba tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:57.847391 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-dc283366-64d6-4d7e-809f-5ff7a7502eba tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:57.848779 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-dc283366-64d6-4d7e-809f-5ff7a7502eba tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:57.860034 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-efaf9c19-b20b-4915-a93c-c6992504b958 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:57.861148 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-efaf9c19-b20b-4915-a93c-c6992504b958 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:57.861587 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-efaf9c19-b20b-4915-a93c-c6992504b958 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:57.862305 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-efaf9c19-b20b-4915-a93c-c6992504b958 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:57.866988 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-efaf9c19-b20b-4915-a93c-c6992504b958 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:57.868460 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-efaf9c19-b20b-4915-a93c-c6992504b958 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:57.873861 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.quota [None req-dc283366-64d6-4d7e-809f-5ff7a7502eba tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Getting quotas for project c5f2240b2c6a43b8a810d84065ec9d44. Resources: {'ram', 'cores', 'instances'} {{(pid=125165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:48:57.897525 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.quota [None req-dc283366-64d6-4d7e-809f-5ff7a7502eba tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Getting quotas for user bee1c05fbfb94433a97928fa2eb5cd15 and project c5f2240b2c6a43b8a810d84065ec9d44. Resources: {'ram', 'cores', 'instances'} {{(pid=125165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:48:57.926018 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-dc283366-64d6-4d7e-809f-5ff7a7502eba tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Going to run 1 instances... {{(pid=125165) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:48:57.936876 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-dc283366-64d6-4d7e-809f-5ff7a7502eba tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7eef2d62-12dc-4746-9cbd-870797d39b4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125165) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:48:58.043558 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-dc283366-64d6-4d7e-809f-5ff7a7502eba tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.951433 Oct 24 08:48:58.048899 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 95/195] 10.222.0.26 () {60 vars in 1147 bytes} [Mon Oct 24 08:48:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:48:58.060256 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-079b6d86-3e4c-4c11-a1cc-cb27bc27327f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:58.060867 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-079b6d86-3e4c-4c11-a1cc-cb27bc27327f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:58.230895 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-079b6d86-3e4c-4c11-a1cc-cb27bc27327f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:58.238421 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-079b6d86-3e4c-4c11-a1cc-cb27bc27327f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5" status: 200 len: 1214 microversion: 2.1 time: 0.182022 Oct 24 08:48:58.242997 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 96/196] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:58 2022] GET /compute/v2.1/servers/2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5 => generated 1214 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:48:58.536142 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-efaf9c19-b20b-4915-a93c-c6992504b958 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:58.545668 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-efaf9c19-b20b-4915-a93c-c6992504b958 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.708823 Oct 24 08:48:58.549032 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 101/197] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:57 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:48:59.269468 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-14dd5283-7790-43ed-89e9-9ce0e3e0ea03 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:59.271114 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-14dd5283-7790-43ed-89e9-9ce0e3e0ea03 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:59.278807 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-14dd5283-7790-43ed-89e9-9ce0e3e0ea03 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:59.279734 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-14dd5283-7790-43ed-89e9-9ce0e3e0ea03 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:59.280466 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-14dd5283-7790-43ed-89e9-9ce0e3e0ea03 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:59.281453 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-14dd5283-7790-43ed-89e9-9ce0e3e0ea03 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:59.282084 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-14dd5283-7790-43ed-89e9-9ce0e3e0ea03 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:59.283452 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-14dd5283-7790-43ed-89e9-9ce0e3e0ea03 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:59.391611 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-14dd5283-7790-43ed-89e9-9ce0e3e0ea03 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:59.413201 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-14dd5283-7790-43ed-89e9-9ce0e3e0ea03 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5" status: 200 len: 1210 microversion: 2.1 time: 0.147417 Oct 24 08:48:59.415307 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 97/198] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:59 2022] GET /compute/v2.1/servers/2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5 => generated 1210 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:48:59.575730 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-b3752753-2e61-42de-a21c-f85fb051a16c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:48:59.577148 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-b3752753-2e61-42de-a21c-f85fb051a16c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:48:59.593846 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b3752753-2e61-42de-a21c-f85fb051a16c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:59.594429 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b3752753-2e61-42de-a21c-f85fb051a16c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:59.595417 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b3752753-2e61-42de-a21c-f85fb051a16c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:59.596339 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b3752753-2e61-42de-a21c-f85fb051a16c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:48:59.597083 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b3752753-2e61-42de-a21c-f85fb051a16c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:48:59.597702 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b3752753-2e61-42de-a21c-f85fb051a16c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:48:59.799061 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-b3752753-2e61-42de-a21c-f85fb051a16c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:48:59.816014 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-b3752753-2e61-42de-a21c-f85fb051a16c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.244058 Oct 24 08:48:59.817149 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 102/199] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:48:59 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:00.440296 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-1a8662f2-8c7d-426b-a29a-35687c04838c tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:00.445720 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-1a8662f2-8c7d-426b-a29a-35687c04838c tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:00.471791 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1a8662f2-8c7d-426b-a29a-35687c04838c tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:00.476831 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1a8662f2-8c7d-426b-a29a-35687c04838c tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:00.477580 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1a8662f2-8c7d-426b-a29a-35687c04838c tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:00.482653 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1a8662f2-8c7d-426b-a29a-35687c04838c tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:00.483783 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1a8662f2-8c7d-426b-a29a-35687c04838c tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:00.500141 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1a8662f2-8c7d-426b-a29a-35687c04838c tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:00.695252 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-1a8662f2-8c7d-426b-a29a-35687c04838c tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:00.707525 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-1a8662f2-8c7d-426b-a29a-35687c04838c tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5" status: 200 len: 1284 microversion: 2.1 time: 0.273705 Oct 24 08:49:00.723978 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 98/200] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:00 2022] GET /compute/v2.1/servers/2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5 => generated 1284 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:00.857771 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-41050ea0-e877-4929-bf47-d95630fb105c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:00.858510 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-41050ea0-e877-4929-bf47-d95630fb105c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:00.878688 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-41050ea0-e877-4929-bf47-d95630fb105c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:00.879289 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-41050ea0-e877-4929-bf47-d95630fb105c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:00.879734 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-41050ea0-e877-4929-bf47-d95630fb105c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:00.880439 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-41050ea0-e877-4929-bf47-d95630fb105c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:00.880890 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-41050ea0-e877-4929-bf47-d95630fb105c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:00.883370 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-41050ea0-e877-4929-bf47-d95630fb105c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:01.134074 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-41050ea0-e877-4929-bf47-d95630fb105c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:01.146418 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-41050ea0-e877-4929-bf47-d95630fb105c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.305063 Oct 24 08:49:01.160502 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 103/201] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:00 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:01.744803 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-d604bee7-e68c-4bdc-b2b2-4e117fedf97f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:01.746683 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-d604bee7-e68c-4bdc-b2b2-4e117fedf97f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:01.774294 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d604bee7-e68c-4bdc-b2b2-4e117fedf97f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:01.775062 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d604bee7-e68c-4bdc-b2b2-4e117fedf97f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:01.778622 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d604bee7-e68c-4bdc-b2b2-4e117fedf97f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:01.779435 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d604bee7-e68c-4bdc-b2b2-4e117fedf97f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:01.783810 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d604bee7-e68c-4bdc-b2b2-4e117fedf97f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:01.784444 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d604bee7-e68c-4bdc-b2b2-4e117fedf97f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:02.173290 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-ba606891-ee72-483f-932f-e7b0b554bf09 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:02.173913 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-ba606891-ee72-483f-932f-e7b0b554bf09 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:02.202387 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ba606891-ee72-483f-932f-e7b0b554bf09 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:02.211500 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ba606891-ee72-483f-932f-e7b0b554bf09 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:02.212633 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ba606891-ee72-483f-932f-e7b0b554bf09 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:02.226480 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ba606891-ee72-483f-932f-e7b0b554bf09 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:02.227279 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ba606891-ee72-483f-932f-e7b0b554bf09 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:02.228506 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ba606891-ee72-483f-932f-e7b0b554bf09 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:02.543660 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-d604bee7-e68c-4bdc-b2b2-4e117fedf97f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:02.553087 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-d604bee7-e68c-4bdc-b2b2-4e117fedf97f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5" status: 200 len: 1314 microversion: 2.1 time: 0.820269 Oct 24 08:49:02.553832 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 99/202] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:01 2022] GET /compute/v2.1/servers/2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5 => generated 1314 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:02.682532 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-ba606891-ee72-483f-932f-e7b0b554bf09 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:02.699600 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-ba606891-ee72-483f-932f-e7b0b554bf09 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.531123 Oct 24 08:49:02.700630 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 104/203] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:02 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:49:03.577144 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-8eba5883-cd1b-4ef3-8c4e-b52e39695cb8 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:03.577757 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-8eba5883-cd1b-4ef3-8c4e-b52e39695cb8 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:03.594540 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8eba5883-cd1b-4ef3-8c4e-b52e39695cb8 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:03.595082 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8eba5883-cd1b-4ef3-8c4e-b52e39695cb8 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:03.595529 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8eba5883-cd1b-4ef3-8c4e-b52e39695cb8 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:03.596258 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8eba5883-cd1b-4ef3-8c4e-b52e39695cb8 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:03.596722 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8eba5883-cd1b-4ef3-8c4e-b52e39695cb8 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:03.597138 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8eba5883-cd1b-4ef3-8c4e-b52e39695cb8 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:03.736199 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-0ff3d3fc-dcd1-41d8-9d3a-e86048f7da88 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:03.737618 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-0ff3d3fc-dcd1-41d8-9d3a-e86048f7da88 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:03.756613 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0ff3d3fc-dcd1-41d8-9d3a-e86048f7da88 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:03.758375 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0ff3d3fc-dcd1-41d8-9d3a-e86048f7da88 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:03.760651 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0ff3d3fc-dcd1-41d8-9d3a-e86048f7da88 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:03.763041 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0ff3d3fc-dcd1-41d8-9d3a-e86048f7da88 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:03.764677 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0ff3d3fc-dcd1-41d8-9d3a-e86048f7da88 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:03.765506 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0ff3d3fc-dcd1-41d8-9d3a-e86048f7da88 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:04.064783 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-8eba5883-cd1b-4ef3-8c4e-b52e39695cb8 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:04.075526 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-8eba5883-cd1b-4ef3-8c4e-b52e39695cb8 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5" status: 200 len: 1314 microversion: 2.1 time: 0.502262 Oct 24 08:49:04.095332 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 100/204] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:03 2022] GET /compute/v2.1/servers/2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5 => generated 1314 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:04.313349 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-711de7a9-fb0c-45b8-a66b-bb3d7eb8fb31 req-1045d11d-09a8-4622-82d6-84f380fc63d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5", "tag": "6e1fcd35-a273-4aa1-b87a-41d8d70dafa2"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:49:04.359249 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-711de7a9-fb0c-45b8-a66b-bb3d7eb8fb31 req-1045d11d-09a8-4622-82d6-84f380fc63d8 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:04.359968 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-711de7a9-fb0c-45b8-a66b-bb3d7eb8fb31 req-1045d11d-09a8-4622-82d6-84f380fc63d8 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:04.362663 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-711de7a9-fb0c-45b8-a66b-bb3d7eb8fb31 req-1045d11d-09a8-4622-82d6-84f380fc63d8 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:04.403508 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-711de7a9-fb0c-45b8-a66b-bb3d7eb8fb31 req-1045d11d-09a8-4622-82d6-84f380fc63d8 service nova] Creating event network-changed:6e1fcd35-a273-4aa1-b87a-41d8d70dafa2 for instance 2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5 on hv-cinder-maste Oct 24 08:49:04.410880 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-711de7a9-fb0c-45b8-a66b-bb3d7eb8fb31 req-1045d11d-09a8-4622-82d6-84f380fc63d8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101948 Oct 24 08:49:04.412877 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 101/205] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:49:04.503725 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-0ff3d3fc-dcd1-41d8-9d3a-e86048f7da88 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:04.515123 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-0ff3d3fc-dcd1-41d8-9d3a-e86048f7da88 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.794481 Oct 24 08:49:04.518254 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 105/206] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:03 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:49:05.115137 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-37a9e664-f615-42df-a295-77270ccd1b83 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:05.117247 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-37a9e664-f615-42df-a295-77270ccd1b83 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:05.126376 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-37a9e664-f615-42df-a295-77270ccd1b83 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:05.142483 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-37a9e664-f615-42df-a295-77270ccd1b83 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:05.145842 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-37a9e664-f615-42df-a295-77270ccd1b83 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:05.146873 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-37a9e664-f615-42df-a295-77270ccd1b83 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:05.151525 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-37a9e664-f615-42df-a295-77270ccd1b83 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:05.155852 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-37a9e664-f615-42df-a295-77270ccd1b83 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:05.483453 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-37a9e664-f615-42df-a295-77270ccd1b83 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:05.494893 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-37a9e664-f615-42df-a295-77270ccd1b83 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5" status: 200 len: 1314 microversion: 2.1 time: 0.386015 Oct 24 08:49:05.496259 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 102/207] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:05 2022] GET /compute/v2.1/servers/2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5 => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:05.542489 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-c482fc2a-c5f1-4dae-8492-dc2c919a8f0d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:05.543658 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-c482fc2a-c5f1-4dae-8492-dc2c919a8f0d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:05.576610 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c482fc2a-c5f1-4dae-8492-dc2c919a8f0d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:05.577437 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c482fc2a-c5f1-4dae-8492-dc2c919a8f0d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:05.578034 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c482fc2a-c5f1-4dae-8492-dc2c919a8f0d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:05.579920 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c482fc2a-c5f1-4dae-8492-dc2c919a8f0d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:05.581432 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c482fc2a-c5f1-4dae-8492-dc2c919a8f0d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:05.582317 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c482fc2a-c5f1-4dae-8492-dc2c919a8f0d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:05.605087 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell1:SELECT=100 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:49:05.842192 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-c482fc2a-c5f1-4dae-8492-dc2c919a8f0d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:05.852058 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-c482fc2a-c5f1-4dae-8492-dc2c919a8f0d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.314502 Oct 24 08:49:05.855567 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 106/208] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:05 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:06.523952 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-79dbdf7d-4799-444a-bf45-8e1dbfef238e tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:06.524776 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-79dbdf7d-4799-444a-bf45-8e1dbfef238e tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:06.545293 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-79dbdf7d-4799-444a-bf45-8e1dbfef238e tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:06.545784 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-79dbdf7d-4799-444a-bf45-8e1dbfef238e tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:06.546301 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-79dbdf7d-4799-444a-bf45-8e1dbfef238e tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:06.547048 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-79dbdf7d-4799-444a-bf45-8e1dbfef238e tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:06.547479 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-79dbdf7d-4799-444a-bf45-8e1dbfef238e tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:06.547999 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-79dbdf7d-4799-444a-bf45-8e1dbfef238e tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:06.774881 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-79dbdf7d-4799-444a-bf45-8e1dbfef238e tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:06.786219 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-79dbdf7d-4799-444a-bf45-8e1dbfef238e tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5" status: 200 len: 1314 microversion: 2.1 time: 0.269051 Oct 24 08:49:06.787073 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 103/209] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:06 2022] GET /compute/v2.1/servers/2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:06.881459 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-ccec0781-9871-4ac3-b3fb-6239c265e6e6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:06.882082 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-ccec0781-9871-4ac3-b3fb-6239c265e6e6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:06.888413 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ccec0781-9871-4ac3-b3fb-6239c265e6e6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:06.889171 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ccec0781-9871-4ac3-b3fb-6239c265e6e6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:06.889798 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ccec0781-9871-4ac3-b3fb-6239c265e6e6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:06.890681 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ccec0781-9871-4ac3-b3fb-6239c265e6e6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:06.891329 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ccec0781-9871-4ac3-b3fb-6239c265e6e6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:06.891942 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ccec0781-9871-4ac3-b3fb-6239c265e6e6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:07.165177 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-ccec0781-9871-4ac3-b3fb-6239c265e6e6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:07.185149 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-ccec0781-9871-4ac3-b3fb-6239c265e6e6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.306693 Oct 24 08:49:07.186386 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 107/210] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:06 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:07.664191 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-c6480b7d-6a5e-4f63-a1a1-bb8857e8c9a8 tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] Action: 'create', calling method: .version_select at 0x7f7ef1728040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-232563932"}} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:49:07.810107 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-e97949a1-af34-4426-ac32-de7d497a349a tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:07.810818 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-e97949a1-af34-4426-ac32-de7d497a349a tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:07.817925 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e97949a1-af34-4426-ac32-de7d497a349a tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:07.818406 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e97949a1-af34-4426-ac32-de7d497a349a tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:07.818869 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e97949a1-af34-4426-ac32-de7d497a349a tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:07.819567 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e97949a1-af34-4426-ac32-de7d497a349a tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:07.820013 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e97949a1-af34-4426-ac32-de7d497a349a tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:07.820431 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e97949a1-af34-4426-ac32-de7d497a349a tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:07.861335 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell0:SELECT=2 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:49:08.199050 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-c6480b7d-6a5e-4f63-a1a1-bb8857e8c9a8 tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.700318 Oct 24 08:49:08.199926 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 104/211] 10.222.0.26 () {60 vars in 1155 bytes} [Mon Oct 24 08:49:07 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 702 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 24 08:49:08.211480 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-0cf6fdf4-9013-4d76-9ba3-6cc3f4d1636a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:08.212095 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-0cf6fdf4-9013-4d76-9ba3-6cc3f4d1636a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:08.221473 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0cf6fdf4-9013-4d76-9ba3-6cc3f4d1636a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:08.221967 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0cf6fdf4-9013-4d76-9ba3-6cc3f4d1636a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:08.222416 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0cf6fdf4-9013-4d76-9ba3-6cc3f4d1636a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:08.227002 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0cf6fdf4-9013-4d76-9ba3-6cc3f4d1636a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:08.227709 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0cf6fdf4-9013-4d76-9ba3-6cc3f4d1636a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:08.228310 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0cf6fdf4-9013-4d76-9ba3-6cc3f4d1636a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:08.239350 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell0:SELECT=8 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:49:08.297797 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-e97949a1-af34-4426-ac32-de7d497a349a tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:08.321226 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-e97949a1-af34-4426-ac32-de7d497a349a tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5" status: 200 len: 1314 microversion: 2.1 time: 0.514890 Oct 24 08:49:08.329253 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 108/212] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:07 2022] GET /compute/v2.1/servers/2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5 => generated 1314 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:08.359567 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-3d113620-a766-4d65-98fc-dc087fe0b0b6 tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] Calling method '.version_select at 0x7f7ef17f5b80>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:08.434363 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-3d113620-a766-4d65-98fc-dc087fe0b0b6 tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/017e1352-5019-4c47-b136-6ebb1c526003" status: 200 len: 344 microversion: 2.1 time: 0.095572 Oct 24 08:49:08.435189 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 109/213] 10.222.0.26 () {58 vars in 1245 bytes} [Mon Oct 24 08:49:08 2022] GET /compute/v2.1/os-volumes/017e1352-5019-4c47-b136-6ebb1c526003 => generated 344 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:49:08.617572 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-0cf6fdf4-9013-4d76-9ba3-6cc3f4d1636a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:08.629784 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-0cf6fdf4-9013-4d76-9ba3-6cc3f4d1636a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.422504 Oct 24 08:49:08.635956 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 105/214] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:08 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:09.348872 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-f4528fa2-e4fa-4b4d-a567-6f7571f521b2 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:09.349437 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-f4528fa2-e4fa-4b4d-a567-6f7571f521b2 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:09.355906 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f4528fa2-e4fa-4b4d-a567-6f7571f521b2 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:09.356595 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f4528fa2-e4fa-4b4d-a567-6f7571f521b2 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:09.357195 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f4528fa2-e4fa-4b4d-a567-6f7571f521b2 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:09.358031 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f4528fa2-e4fa-4b4d-a567-6f7571f521b2 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:09.358780 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f4528fa2-e4fa-4b4d-a567-6f7571f521b2 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:09.359356 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f4528fa2-e4fa-4b4d-a567-6f7571f521b2 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:09.450345 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-43bc1df8-f187-4703-a533-601543f1bb0b tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] Calling method '.version_select at 0x7f7ef1728e50>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:09.512101 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-43bc1df8-f187-4703-a533-601543f1bb0b tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/017e1352-5019-4c47-b136-6ebb1c526003" status: 200 len: 345 microversion: 2.1 time: 0.066952 Oct 24 08:49:09.512673 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 106/215] 10.222.0.26 () {58 vars in 1245 bytes} [Mon Oct 24 08:49:09 2022] GET /compute/v2.1/os-volumes/017e1352-5019-4c47-b136-6ebb1c526003 => generated 345 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:49:09.528473 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-f4528fa2-e4fa-4b4d-a567-6f7571f521b2 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:09.532687 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-3f49efcd-5a84-4570-a209-56c2478cb32d tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] Action: 'create', calling method: .version_select at 0x7f7ef1728700>, body: {"snapshot": {"volume_id": "017e1352-5019-4c47-b136-6ebb1c526003", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-264771761"}} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:49:09.544950 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-f4528fa2-e4fa-4b4d-a567-6f7571f521b2 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5" status: 200 len: 1314 microversion: 2.1 time: 0.197476 Oct 24 08:49:09.545551 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 110/216] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:09 2022] GET /compute/v2.1/servers/2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:09.656829 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-7f205fba-705b-4ee0-925b-3c8e1582a2da tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:09.657928 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-7f205fba-705b-4ee0-925b-3c8e1582a2da tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:09.666070 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7f205fba-705b-4ee0-925b-3c8e1582a2da tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:09.666802 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7f205fba-705b-4ee0-925b-3c8e1582a2da tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:09.667471 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7f205fba-705b-4ee0-925b-3c8e1582a2da tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:09.670759 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7f205fba-705b-4ee0-925b-3c8e1582a2da tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:09.671407 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7f205fba-705b-4ee0-925b-3c8e1582a2da tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:09.671978 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7f205fba-705b-4ee0-925b-3c8e1582a2da tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:09.774116 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-3f49efcd-5a84-4570-a209-56c2478cb32d tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.251942 Oct 24 08:49:09.775070 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 107/217] 10.222.0.26 () {60 vars in 1162 bytes} [Mon Oct 24 08:49:09 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:49:09.786341 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-f26efb80-09d0-48ee-b34c-0973c0dd31bc tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] Calling method '.version_select at 0x7f7ef1734160>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:09.873130 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-f26efb80-09d0-48ee-b34c-0973c0dd31bc tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/e6aec5c5-221f-4229-81d9-3e1c035f65f6" status: 200 len: 286 microversion: 2.1 time: 0.090949 Oct 24 08:49:09.875381 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 108/218] 10.222.0.26 () {58 vars in 1251 bytes} [Mon Oct 24 08:49:09 2022] GET /compute/v2.1/os-snapshots/e6aec5c5-221f-4229-81d9-3e1c035f65f6 => generated 286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:49:09.886553 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-76548a1c-7e82-4401-b9e2-4e23bba75b7b tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] Calling method '.version_select at 0x7f7ef19623a0>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:09.923295 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-7f205fba-705b-4ee0-925b-3c8e1582a2da tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:09.932369 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-7f205fba-705b-4ee0-925b-3c8e1582a2da tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.282870 Oct 24 08:49:09.941637 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 111/219] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:09 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:49:09.949482 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-76548a1c-7e82-4401-b9e2-4e23bba75b7b tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.065101 Oct 24 08:49:09.950812 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 109/220] 10.222.0.26 () {58 vars in 1140 bytes} [Mon Oct 24 08:49:09 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:49:09.962654 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-276465aa-0cf5-4264-8ff1-05b5d29d913c tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] Calling method '.version_select at 0x7f7ef17f30d0>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:09.999393 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-276465aa-0cf5-4264-8ff1-05b5d29d913c tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/e6aec5c5-221f-4229-81d9-3e1c035f65f6" status: 200 len: 286 microversion: 2.1 time: 0.040732 Oct 24 08:49:10.000358 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 112/221] 10.222.0.26 () {58 vars in 1251 bytes} [Mon Oct 24 08:49:09 2022] GET /compute/v2.1/os-snapshots/e6aec5c5-221f-4229-81d9-3e1c035f65f6 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:49:10.125323 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-a80aeb15-8f02-4afd-a44b-608006416ae5 req-22b5908e-09b7-4fbe-8db0-e1a845236f1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5", "name": "network-vif-plugged", "status": "completed", "tag": "6e1fcd35-a273-4aa1-b87a-41d8d70dafa2"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:49:10.132243 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:49:10.140519 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-a80aeb15-8f02-4afd-a44b-608006416ae5 req-22b5908e-09b7-4fbe-8db0-e1a845236f1f service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:10.141455 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-a80aeb15-8f02-4afd-a44b-608006416ae5 req-22b5908e-09b7-4fbe-8db0-e1a845236f1f service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:10.142091 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-a80aeb15-8f02-4afd-a44b-608006416ae5 req-22b5908e-09b7-4fbe-8db0-e1a845236f1f service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:10.161381 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-a80aeb15-8f02-4afd-a44b-608006416ae5 req-22b5908e-09b7-4fbe-8db0-e1a845236f1f service nova] Creating event network-vif-plugged:6e1fcd35-a273-4aa1-b87a-41d8d70dafa2 for instance 2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5 on hv-cinder-maste Oct 24 08:49:10.169716 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-a80aeb15-8f02-4afd-a44b-608006416ae5 req-22b5908e-09b7-4fbe-8db0-e1a845236f1f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048899 Oct 24 08:49:10.170980 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 110/222] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:49:10.569278 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-07fcb59d-c9ef-46a1-9ed5-5ffa92b85848 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:10.569881 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-07fcb59d-c9ef-46a1-9ed5-5ffa92b85848 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:10.578870 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-07fcb59d-c9ef-46a1-9ed5-5ffa92b85848 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:10.579647 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-07fcb59d-c9ef-46a1-9ed5-5ffa92b85848 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:10.580257 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-07fcb59d-c9ef-46a1-9ed5-5ffa92b85848 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:10.581330 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-07fcb59d-c9ef-46a1-9ed5-5ffa92b85848 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:10.581931 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-07fcb59d-c9ef-46a1-9ed5-5ffa92b85848 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:10.583425 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-07fcb59d-c9ef-46a1-9ed5-5ffa92b85848 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:10.749620 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-07fcb59d-c9ef-46a1-9ed5-5ffa92b85848 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:10.764470 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-07fcb59d-c9ef-46a1-9ed5-5ffa92b85848 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5" status: 200 len: 1314 microversion: 2.1 time: 0.199062 Oct 24 08:49:10.765416 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 113/223] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:10 2022] GET /compute/v2.1/servers/2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:10.964390 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-49e04c48-4d31-409c-b6d9-14c4d2bced44 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:10.964978 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-49e04c48-4d31-409c-b6d9-14c4d2bced44 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:10.977527 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-49e04c48-4d31-409c-b6d9-14c4d2bced44 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:10.978311 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-49e04c48-4d31-409c-b6d9-14c4d2bced44 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:10.978949 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-49e04c48-4d31-409c-b6d9-14c4d2bced44 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:10.979811 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-49e04c48-4d31-409c-b6d9-14c4d2bced44 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:10.980404 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-49e04c48-4d31-409c-b6d9-14c4d2bced44 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:10.981028 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-49e04c48-4d31-409c-b6d9-14c4d2bced44 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:11.013453 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-40b4bba1-7ae8-4e8b-90b2-82d0acdd7399 tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] Calling method '.version_select at 0x7f7ef17f38b0>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:11.060506 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-40b4bba1-7ae8-4e8b-90b2-82d0acdd7399 tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/e6aec5c5-221f-4229-81d9-3e1c035f65f6" status: 200 len: 287 microversion: 2.1 time: 0.050748 Oct 24 08:49:11.061438 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 114/224] 10.222.0.26 () {58 vars in 1251 bytes} [Mon Oct 24 08:49:11 2022] GET /compute/v2.1/os-snapshots/e6aec5c5-221f-4229-81d9-3e1c035f65f6 => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:49:11.073600 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-bbddf5f5-1d75-49ec-b034-410616a27f72 tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] Calling method '.version_select at 0x7f7ef17f34c0>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:11.152067 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-bbddf5f5-1d75-49ec-b034-410616a27f72 tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/e6aec5c5-221f-4229-81d9-3e1c035f65f6" status: 202 len: 0 microversion: 2.1 time: 0.082631 Oct 24 08:49:11.152284 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-49e04c48-4d31-409c-b6d9-14c4d2bced44 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:11.153713 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 115/225] 10.222.0.26 () {58 vars in 1254 bytes} [Mon Oct 24 08:49:11 2022] DELETE /compute/v2.1/os-snapshots/e6aec5c5-221f-4229-81d9-3e1c035f65f6 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 08:49:11.160914 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-f20c1880-8b7e-44eb-9807-ce6c84489ba5 tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] Calling method '.version_select at 0x7f7ef22c1e50>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:11.161062 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-49e04c48-4d31-409c-b6d9-14c4d2bced44 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.201093 Oct 24 08:49:11.161853 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 111/226] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:10 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:11.208696 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-f20c1880-8b7e-44eb-9807-ce6c84489ba5 tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/e6aec5c5-221f-4229-81d9-3e1c035f65f6" status: 200 len: 286 microversion: 2.1 time: 0.051510 Oct 24 08:49:11.210238 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 116/227] 10.222.0.26 () {58 vars in 1251 bytes} [Mon Oct 24 08:49:11 2022] GET /compute/v2.1/os-snapshots/e6aec5c5-221f-4229-81d9-3e1c035f65f6 => generated 286 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:49:11.788830 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-28ba0254-497a-4ce3-8599-6af1817206e4 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:11.790143 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-28ba0254-497a-4ce3-8599-6af1817206e4 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:11.797101 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-28ba0254-497a-4ce3-8599-6af1817206e4 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:11.797868 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-28ba0254-497a-4ce3-8599-6af1817206e4 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:11.798634 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-28ba0254-497a-4ce3-8599-6af1817206e4 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:11.799516 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-28ba0254-497a-4ce3-8599-6af1817206e4 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:11.800150 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-28ba0254-497a-4ce3-8599-6af1817206e4 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:11.800717 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-28ba0254-497a-4ce3-8599-6af1817206e4 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:11.988880 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-28ba0254-497a-4ce3-8599-6af1817206e4 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:11.997185 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-28ba0254-497a-4ce3-8599-6af1817206e4 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5" status: 200 len: 1314 microversion: 2.1 time: 0.212915 Oct 24 08:49:11.998050 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 112/228] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:11 2022] GET /compute/v2.1/servers/2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:12.188481 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-218ffbad-6c5e-48b1-92fb-0d8545766c7a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:12.189978 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-218ffbad-6c5e-48b1-92fb-0d8545766c7a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:12.198464 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-218ffbad-6c5e-48b1-92fb-0d8545766c7a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:12.199251 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-218ffbad-6c5e-48b1-92fb-0d8545766c7a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:12.200105 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-218ffbad-6c5e-48b1-92fb-0d8545766c7a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:12.200807 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-218ffbad-6c5e-48b1-92fb-0d8545766c7a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:12.201262 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-218ffbad-6c5e-48b1-92fb-0d8545766c7a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:12.201679 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-218ffbad-6c5e-48b1-92fb-0d8545766c7a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:12.222684 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-b6571d52-69f9-4852-a7db-2d087b8d103a tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] Calling method '.version_select at 0x7f7ef178b700>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:12.257414 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.wsgi [None req-b6571d52-69f9-4852-a7db-2d087b8d103a tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] HTTP exception thrown: Snapshot e6aec5c5-221f-4229-81d9-3e1c035f65f6 could not be found. Oct 24 08:49:12.260273 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-b6571d52-69f9-4852-a7db-2d087b8d103a tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] Request method failure captured: Oct 24 08:49:12.260273 dv-cinder-master-3-smb devstack@n-api.service[125165]: request: GET /compute/v2.1/os-snapshots/e6aec5c5-221f-4229-81d9-3e1c035f65f6 HTTP/1.1 Oct 24 08:49:12.260273 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept: application/json Oct 24 08:49:12.260273 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept-Encoding: identity Oct 24 08:49:12.260273 dv-cinder-master-3-smb devstack@n-api.service[125165]: Connection: close Oct 24 08:49:12.260273 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Length: 0 Oct 24 08:49:12.260273 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Type: application/json Oct 24 08:49:12.260273 dv-cinder-master-3-smb devstack@n-api.service[125165]: Host: 10.222.0.26 Oct 24 08:49:12.260273 dv-cinder-master-3-smb devstack@n-api.service[125165]: Openstack-System-Scope: None Oct 24 08:49:12.260273 dv-cinder-master-3-smb devstack@n-api.service[125165]: User-Agent: python-urllib3/1.26.12 Oct 24 08:49:12.260273 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Auth-Token: gAAAAABjVlGDfeDp4-mggGp9coxQ-wSNIfO3JsW5auAiYUMmJXG0KAANmSHflNup8I23tdI-_-j40aI4EKp4T27XK0lFK08nW4xQLnaJSEP3t_A7aEujJecQ-s5XdQfcWuzspG_dw60uWeCytGizO98oyT5JEZRkjI3EmCcvMRwZ2gfFi3PoV3o Oct 24 08:49:12.260273 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Id: None Oct 24 08:49:12.260273 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Name: None Oct 24 08:49:12.260273 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Identity-Status: Confirmed Oct 24 08:49:12.260273 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Is-Admin-Project: True Oct 24 08:49:12.260273 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Id: default Oct 24 08:49:12.260273 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Name: Default Oct 24 08:49:12.260273 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Id: 0001092a700c4a76bbbfd678b6df7e51 Oct 24 08:49:12.260273 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1257941408 Oct 24 08:49:12.260273 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Role: reader,member Oct 24 08:49:12.260273 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Roles: reader,member Oct 24 08:49:12.261681 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0001092a700c4a76bbbfd678b6df7e51", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0001092a700c4a76bbbfd678b6df7e51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0001092a700c4a76bbbfd678b6df7e51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0001092a700c4a76bbbfd678b6df7e51"}]}] Oct 24 08:49:12.261681 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1257941408 Oct 24 08:49:12.261681 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Id: 0001092a700c4a76bbbfd678b6df7e51 Oct 24 08:49:12.261681 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1257941408 Oct 24 08:49:12.261681 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User: tempest-VolumesSnapshotsTestJSON-1257941408-project Oct 24 08:49:12.261681 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Id: default Oct 24 08:49:12.261681 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Name: Default Oct 24 08:49:12.261681 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Id: 365f391239574744be58dc5cd4ef986c Oct 24 08:49:12.261681 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1257941408-project Oct 24 08:49:12.261681 dv-cinder-master-3-smb devstack@n-api.service[125165]: method: Oct 24 08:49:12.261681 dv-cinder-master-3-smb devstack@n-api.service[125165]: exception: Snapshot e6aec5c5-221f-4229-81d9-3e1c035f65f6 could not be found. Oct 24 08:49:12.261681 dv-cinder-master-3-smb devstack@n-api.service[125165]: action_args: {'id': 'e6aec5c5-221f-4229-81d9-3e1c035f65f6'} Oct 24 08:49:12.261681 dv-cinder-master-3-smb devstack@n-api.service[125165]: {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:49:12.262486 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:49:12.262486 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 24 08:49:12.262486 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 24 08:49:12.262486 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 24 08:49:12.262486 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 24 08:49:12.262486 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 24 08:49:12.262486 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 24 08:49:12.262486 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 08:49:12.262486 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 08:49:12.262486 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 08:49:12.262486 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 08:49:12.262486 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 08:49:12.262486 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 08:49:12.262486 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 08:49:12.262486 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 08:49:12.262486 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e6aec5c5-221f-4229-81d9-3e1c035f65f6 could not be found. (HTTP 404) (Request-ID: req-3d9b5c3a-d0f3-4f62-b54e-5d8fcd6c3de6) Oct 24 08:49:12.262486 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:49:12.262486 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:49:12.263753 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:49:12.263753 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:49:12.263753 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 24 08:49:12.263753 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 24 08:49:12.263753 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 08:49:12.263753 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 08:49:12.263753 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 24 08:49:12.263753 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 24 08:49:12.263753 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 08:49:12.263753 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 08:49:12.263753 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 24 08:49:12.263753 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 24 08:49:12.263753 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 24 08:49:12.263753 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 24 08:49:12.263753 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 24 08:49:12.263753 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 24 08:49:12.263753 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 08:49:12.263753 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 08:49:12.263753 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 08:49:12.264803 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 08:49:12.264803 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 08:49:12.264803 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 08:49:12.264803 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 08:49:12.264803 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 08:49:12.264803 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e6aec5c5-221f-4229-81d9-3e1c035f65f6 could not be found. Oct 24 08:49:12.264803 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:49:12.264803 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:49:12.264803 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:49:12.264803 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:49:12.264803 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:49:12.264803 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:49:12.264803 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:49:12.264803 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:49:12.264803 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:49:12.264803 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:49:12.264803 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:49:12.264803 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:49:12.264803 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 24 08:49:12.264803 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:49:12.266651 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e6aec5c5-221f-4229-81d9-3e1c035f65f6 could not be found. Oct 24 08:49:12.266651 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:49:12.266651 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:49:12.266651 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:49:12.266651 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:49:12.266651 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:49:12.266651 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:49:12.266651 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:49:12.266651 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:49:12.266651 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e6aec5c5-221f-4229-81d9-3e1c035f65f6 could not be found. Oct 24 08:49:12.266651 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:49:12.266651 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-b6571d52-69f9-4852-a7db-2d087b8d103a tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] Returning 404 to user: Snapshot e6aec5c5-221f-4229-81d9-3e1c035f65f6 could not be found. {{(pid=125165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:49:12.266651 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-b6571d52-69f9-4852-a7db-2d087b8d103a tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/e6aec5c5-221f-4229-81d9-3e1c035f65f6" status: 404 len: 111 microversion: 2.1 time: 0.043042 Oct 24 08:49:12.268843 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 113/229] 10.222.0.26 () {58 vars in 1251 bytes} [Mon Oct 24 08:49:12 2022] GET /compute/v2.1/os-snapshots/e6aec5c5-221f-4229-81d9-3e1c035f65f6 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 08:49:12.271305 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-fad40a8e-b003-4946-afc9-c078ecf9c896 tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] Calling method '.version_select at 0x7f7ef17288b0>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:12.369561 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-fad40a8e-b003-4946-afc9-c078ecf9c896 tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/017e1352-5019-4c47-b136-6ebb1c526003" status: 202 len: 0 microversion: 2.1 time: 0.102368 Oct 24 08:49:12.370122 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 114/230] 10.222.0.26 () {58 vars in 1248 bytes} [Mon Oct 24 08:49:12 2022] DELETE /compute/v2.1/os-volumes/017e1352-5019-4c47-b136-6ebb1c526003 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:49:12.378560 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-67724a93-10d1-422c-b990-52e9c1bd09e2 tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] Calling method '.version_select at 0x7f7ef178bf70>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:12.382768 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-218ffbad-6c5e-48b1-92fb-0d8545766c7a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:12.391127 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-218ffbad-6c5e-48b1-92fb-0d8545766c7a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.207047 Oct 24 08:49:12.406622 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 117/231] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:12 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:12.437604 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-67724a93-10d1-422c-b990-52e9c1bd09e2 tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/017e1352-5019-4c47-b136-6ebb1c526003" status: 200 len: 344 microversion: 2.1 time: 0.063139 Oct 24 08:49:12.439426 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 115/232] 10.222.0.26 () {58 vars in 1245 bytes} [Mon Oct 24 08:49:12 2022] GET /compute/v2.1/os-volumes/017e1352-5019-4c47-b136-6ebb1c526003 => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:49:13.021166 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-d3962e92-5011-4e5a-829d-1bb55ea32f6f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:13.021773 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-d3962e92-5011-4e5a-829d-1bb55ea32f6f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:13.027869 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d3962e92-5011-4e5a-829d-1bb55ea32f6f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:13.028350 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d3962e92-5011-4e5a-829d-1bb55ea32f6f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:13.028784 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d3962e92-5011-4e5a-829d-1bb55ea32f6f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:13.029461 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d3962e92-5011-4e5a-829d-1bb55ea32f6f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:13.029915 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d3962e92-5011-4e5a-829d-1bb55ea32f6f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:13.030323 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d3962e92-5011-4e5a-829d-1bb55ea32f6f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:13.170227 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-d3962e92-5011-4e5a-829d-1bb55ea32f6f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:13.178569 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-d3962e92-5011-4e5a-829d-1bb55ea32f6f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5" status: 200 len: 1498 microversion: 2.1 time: 0.161356 Oct 24 08:49:13.191317 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 118/233] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:13 2022] GET /compute/v2.1/servers/2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5 => generated 1498 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:13.414582 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-c9bfced0-6e64-44ab-9204-336f26de1317 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:13.416367 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-c9bfced0-6e64-44ab-9204-336f26de1317 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:13.422824 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c9bfced0-6e64-44ab-9204-336f26de1317 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:13.423620 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c9bfced0-6e64-44ab-9204-336f26de1317 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:13.424288 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c9bfced0-6e64-44ab-9204-336f26de1317 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:13.425169 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c9bfced0-6e64-44ab-9204-336f26de1317 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:13.425786 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c9bfced0-6e64-44ab-9204-336f26de1317 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:13.426422 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c9bfced0-6e64-44ab-9204-336f26de1317 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:13.457870 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-ba885ef1-085d-4116-81af-6e35dc20146e tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] Calling method '.version_select at 0x7f7ef17ff9d0>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:13.514288 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.wsgi [None req-ba885ef1-085d-4116-81af-6e35dc20146e tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] HTTP exception thrown: Volume 017e1352-5019-4c47-b136-6ebb1c526003 could not be found. Oct 24 08:49:13.518175 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-ba885ef1-085d-4116-81af-6e35dc20146e tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] Request method failure captured: Oct 24 08:49:13.518175 dv-cinder-master-3-smb devstack@n-api.service[125164]: request: GET /compute/v2.1/os-volumes/017e1352-5019-4c47-b136-6ebb1c526003 HTTP/1.1 Oct 24 08:49:13.518175 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept: application/json Oct 24 08:49:13.518175 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept-Encoding: identity Oct 24 08:49:13.518175 dv-cinder-master-3-smb devstack@n-api.service[125164]: Connection: close Oct 24 08:49:13.518175 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Length: 0 Oct 24 08:49:13.518175 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Type: application/json Oct 24 08:49:13.518175 dv-cinder-master-3-smb devstack@n-api.service[125164]: Host: 10.222.0.26 Oct 24 08:49:13.518175 dv-cinder-master-3-smb devstack@n-api.service[125164]: Openstack-System-Scope: None Oct 24 08:49:13.518175 dv-cinder-master-3-smb devstack@n-api.service[125164]: User-Agent: python-urllib3/1.26.12 Oct 24 08:49:13.518175 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Auth-Token: gAAAAABjVlGDfeDp4-mggGp9coxQ-wSNIfO3JsW5auAiYUMmJXG0KAANmSHflNup8I23tdI-_-j40aI4EKp4T27XK0lFK08nW4xQLnaJSEP3t_A7aEujJecQ-s5XdQfcWuzspG_dw60uWeCytGizO98oyT5JEZRkjI3EmCcvMRwZ2gfFi3PoV3o Oct 24 08:49:13.518175 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Id: None Oct 24 08:49:13.518175 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Name: None Oct 24 08:49:13.518175 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Identity-Status: Confirmed Oct 24 08:49:13.518175 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Is-Admin-Project: True Oct 24 08:49:13.518175 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Id: default Oct 24 08:49:13.518175 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Name: Default Oct 24 08:49:13.518175 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Id: 0001092a700c4a76bbbfd678b6df7e51 Oct 24 08:49:13.518175 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1257941408 Oct 24 08:49:13.518175 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Role: reader,member Oct 24 08:49:13.518175 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Roles: reader,member Oct 24 08:49:13.519738 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0001092a700c4a76bbbfd678b6df7e51", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0001092a700c4a76bbbfd678b6df7e51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0001092a700c4a76bbbfd678b6df7e51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0001092a700c4a76bbbfd678b6df7e51"}]}] Oct 24 08:49:13.519738 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1257941408 Oct 24 08:49:13.519738 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Id: 0001092a700c4a76bbbfd678b6df7e51 Oct 24 08:49:13.519738 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1257941408 Oct 24 08:49:13.519738 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User: tempest-VolumesSnapshotsTestJSON-1257941408-project Oct 24 08:49:13.519738 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Id: default Oct 24 08:49:13.519738 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Name: Default Oct 24 08:49:13.519738 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Id: 365f391239574744be58dc5cd4ef986c Oct 24 08:49:13.519738 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1257941408-project Oct 24 08:49:13.519738 dv-cinder-master-3-smb devstack@n-api.service[125164]: method: Oct 24 08:49:13.519738 dv-cinder-master-3-smb devstack@n-api.service[125164]: exception: Volume 017e1352-5019-4c47-b136-6ebb1c526003 could not be found. Oct 24 08:49:13.519738 dv-cinder-master-3-smb devstack@n-api.service[125164]: action_args: {'id': '017e1352-5019-4c47-b136-6ebb1c526003'} Oct 24 08:49:13.519738 dv-cinder-master-3-smb devstack@n-api.service[125164]: {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:49:13.520595 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:49:13.520595 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 08:49:13.520595 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 08:49:13.520595 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 08:49:13.520595 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 08:49:13.520595 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 08:49:13.520595 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 08:49:13.520595 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 08:49:13.520595 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 08:49:13.520595 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 08:49:13.520595 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 08:49:13.520595 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 08:49:13.520595 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 08:49:13.520595 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 08:49:13.520595 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 08:49:13.520595 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 017e1352-5019-4c47-b136-6ebb1c526003 could not be found. (HTTP 404) (Request-ID: req-c1fbe9a8-6c4b-46c4-b5b3-185f66ae9629) Oct 24 08:49:13.520595 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:49:13.520595 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:49:13.520595 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:49:13.521644 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:49:13.521644 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 24 08:49:13.521644 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 24 08:49:13.521644 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 08:49:13.521644 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 08:49:13.521644 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 08:49:13.521644 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 08:49:13.521644 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 08:49:13.521644 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 08:49:13.521644 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 08:49:13.521644 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 08:49:13.521644 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 08:49:13.521644 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 08:49:13.521644 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 08:49:13.521644 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 08:49:13.521644 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 08:49:13.521644 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 08:49:13.521644 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 08:49:13.521644 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 08:49:13.522651 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 08:49:13.522651 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 08:49:13.522651 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 08:49:13.522651 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 08:49:13.522651 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 017e1352-5019-4c47-b136-6ebb1c526003 could not be found. Oct 24 08:49:13.522651 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:49:13.522651 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:49:13.522651 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:49:13.522651 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:49:13.522651 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:49:13.522651 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:49:13.522651 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:49:13.522651 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:49:13.522651 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:49:13.522651 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:49:13.522651 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:49:13.522651 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:49:13.522651 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 24 08:49:13.522651 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:49:13.524181 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 017e1352-5019-4c47-b136-6ebb1c526003 could not be found. Oct 24 08:49:13.524181 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:49:13.524181 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:49:13.524181 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:49:13.524181 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:49:13.524181 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:49:13.524181 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:49:13.524181 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:49:13.524181 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:49:13.524181 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 017e1352-5019-4c47-b136-6ebb1c526003 could not be found. Oct 24 08:49:13.524181 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:49:13.524181 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-ba885ef1-085d-4116-81af-6e35dc20146e tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] Returning 404 to user: Volume 017e1352-5019-4c47-b136-6ebb1c526003 could not be found. {{(pid=125164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:49:13.524181 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-ba885ef1-085d-4116-81af-6e35dc20146e tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/017e1352-5019-4c47-b136-6ebb1c526003" status: 404 len: 109 microversion: 2.1 time: 0.069618 Oct 24 08:49:13.524181 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 119/234] 10.222.0.26 () {58 vars in 1245 bytes} [Mon Oct 24 08:49:13 2022] GET /compute/v2.1/os-volumes/017e1352-5019-4c47-b136-6ebb1c526003 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 08:49:13.534027 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-e72fd0a6-df4c-4a6b-8bef-173f30fbc20f tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] Calling method '.version_select at 0x7f7ef17a9d30>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:13.573734 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.wsgi [None req-e72fd0a6-df4c-4a6b-8bef-173f30fbc20f tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] HTTP exception thrown: Volume 017e1352-5019-4c47-b136-6ebb1c526003 could not be found. Oct 24 08:49:13.576048 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-e72fd0a6-df4c-4a6b-8bef-173f30fbc20f tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] Request method failure captured: Oct 24 08:49:13.576048 dv-cinder-master-3-smb devstack@n-api.service[125164]: request: DELETE /compute/v2.1/os-volumes/017e1352-5019-4c47-b136-6ebb1c526003 HTTP/1.1 Oct 24 08:49:13.576048 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept: application/json Oct 24 08:49:13.576048 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept-Encoding: identity Oct 24 08:49:13.576048 dv-cinder-master-3-smb devstack@n-api.service[125164]: Connection: close Oct 24 08:49:13.576048 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Length: 0 Oct 24 08:49:13.576048 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Type: application/json Oct 24 08:49:13.576048 dv-cinder-master-3-smb devstack@n-api.service[125164]: Host: 10.222.0.26 Oct 24 08:49:13.576048 dv-cinder-master-3-smb devstack@n-api.service[125164]: Openstack-System-Scope: None Oct 24 08:49:13.576048 dv-cinder-master-3-smb devstack@n-api.service[125164]: User-Agent: python-urllib3/1.26.12 Oct 24 08:49:13.576048 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Auth-Token: gAAAAABjVlGDfeDp4-mggGp9coxQ-wSNIfO3JsW5auAiYUMmJXG0KAANmSHflNup8I23tdI-_-j40aI4EKp4T27XK0lFK08nW4xQLnaJSEP3t_A7aEujJecQ-s5XdQfcWuzspG_dw60uWeCytGizO98oyT5JEZRkjI3EmCcvMRwZ2gfFi3PoV3o Oct 24 08:49:13.576048 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Id: None Oct 24 08:49:13.576048 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Name: None Oct 24 08:49:13.576048 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Identity-Status: Confirmed Oct 24 08:49:13.576048 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Is-Admin-Project: True Oct 24 08:49:13.576048 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Id: default Oct 24 08:49:13.576048 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Name: Default Oct 24 08:49:13.576048 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Id: 0001092a700c4a76bbbfd678b6df7e51 Oct 24 08:49:13.576048 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1257941408 Oct 24 08:49:13.576048 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Role: reader,member Oct 24 08:49:13.576048 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Roles: reader,member Oct 24 08:49:13.577361 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0001092a700c4a76bbbfd678b6df7e51", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0001092a700c4a76bbbfd678b6df7e51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0001092a700c4a76bbbfd678b6df7e51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0001092a700c4a76bbbfd678b6df7e51"}]}] Oct 24 08:49:13.577361 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1257941408 Oct 24 08:49:13.577361 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Id: 0001092a700c4a76bbbfd678b6df7e51 Oct 24 08:49:13.577361 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1257941408 Oct 24 08:49:13.577361 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User: tempest-VolumesSnapshotsTestJSON-1257941408-project Oct 24 08:49:13.577361 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Id: default Oct 24 08:49:13.577361 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Name: Default Oct 24 08:49:13.577361 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Id: 365f391239574744be58dc5cd4ef986c Oct 24 08:49:13.577361 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1257941408-project Oct 24 08:49:13.577361 dv-cinder-master-3-smb devstack@n-api.service[125164]: method: Oct 24 08:49:13.577361 dv-cinder-master-3-smb devstack@n-api.service[125164]: exception: Volume 017e1352-5019-4c47-b136-6ebb1c526003 could not be found. Oct 24 08:49:13.577361 dv-cinder-master-3-smb devstack@n-api.service[125164]: action_args: {'id': '017e1352-5019-4c47-b136-6ebb1c526003'} Oct 24 08:49:13.577361 dv-cinder-master-3-smb devstack@n-api.service[125164]: {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:49:13.578084 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:49:13.578084 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 08:49:13.578084 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 08:49:13.578084 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 24 08:49:13.578084 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 24 08:49:13.578084 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 24 08:49:13.578084 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 24 08:49:13.578084 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 24 08:49:13.578084 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 24 08:49:13.578084 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 24 08:49:13.578084 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 24 08:49:13.578084 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 08:49:13.578084 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 08:49:13.578084 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 08:49:13.578084 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 08:49:13.578084 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 017e1352-5019-4c47-b136-6ebb1c526003 could not be found. (HTTP 404) (Request-ID: req-a2f3b362-82c2-49c5-b93a-62e815e949b1) Oct 24 08:49:13.578084 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:49:13.578084 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:49:13.578084 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:49:13.579215 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:49:13.579215 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 24 08:49:13.579215 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 24 08:49:13.579215 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 08:49:13.579215 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 08:49:13.579215 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 08:49:13.579215 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 08:49:13.579215 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 08:49:13.579215 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 08:49:13.579215 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 08:49:13.579215 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 08:49:13.579215 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 24 08:49:13.579215 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 24 08:49:13.579215 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 24 08:49:13.579215 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 24 08:49:13.579215 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 24 08:49:13.579215 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 24 08:49:13.579215 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 24 08:49:13.579215 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 24 08:49:13.580311 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 08:49:13.580311 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 08:49:13.580311 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 08:49:13.580311 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 08:49:13.580311 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 017e1352-5019-4c47-b136-6ebb1c526003 could not be found. Oct 24 08:49:13.580311 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:49:13.580311 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:49:13.580311 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:49:13.580311 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:49:13.580311 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:49:13.580311 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:49:13.580311 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:49:13.580311 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:49:13.580311 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:49:13.580311 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:49:13.580311 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:49:13.580311 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:49:13.580311 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 24 08:49:13.580311 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:49:13.581338 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 017e1352-5019-4c47-b136-6ebb1c526003 could not be found. Oct 24 08:49:13.581338 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:49:13.581338 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:49:13.581338 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:49:13.581338 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:49:13.581338 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:49:13.581338 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:49:13.581338 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:49:13.581338 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:49:13.581338 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 017e1352-5019-4c47-b136-6ebb1c526003 could not be found. Oct 24 08:49:13.581338 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:49:13.583255 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-e72fd0a6-df4c-4a6b-8bef-173f30fbc20f tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] Returning 404 to user: Volume 017e1352-5019-4c47-b136-6ebb1c526003 could not be found. {{(pid=125164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:49:13.584274 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-e72fd0a6-df4c-4a6b-8bef-173f30fbc20f tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/017e1352-5019-4c47-b136-6ebb1c526003" status: 404 len: 109 microversion: 2.1 time: 0.054379 Oct 24 08:49:13.585385 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 120/235] 10.222.0.26 () {58 vars in 1248 bytes} [Mon Oct 24 08:49:13 2022] DELETE /compute/v2.1/os-volumes/017e1352-5019-4c47-b136-6ebb1c526003 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 08:49:13.596036 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-f388752f-5d2b-4547-a603-202441a65441 tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] Calling method '.version_select at 0x7f7ef17ff9d0>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:13.629698 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.wsgi [None req-f388752f-5d2b-4547-a603-202441a65441 tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] HTTP exception thrown: Volume 017e1352-5019-4c47-b136-6ebb1c526003 could not be found. Oct 24 08:49:13.632037 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-f388752f-5d2b-4547-a603-202441a65441 tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] Request method failure captured: Oct 24 08:49:13.632037 dv-cinder-master-3-smb devstack@n-api.service[125164]: request: GET /compute/v2.1/os-volumes/017e1352-5019-4c47-b136-6ebb1c526003 HTTP/1.1 Oct 24 08:49:13.632037 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept: application/json Oct 24 08:49:13.632037 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept-Encoding: identity Oct 24 08:49:13.632037 dv-cinder-master-3-smb devstack@n-api.service[125164]: Connection: close Oct 24 08:49:13.632037 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Length: 0 Oct 24 08:49:13.632037 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Type: application/json Oct 24 08:49:13.632037 dv-cinder-master-3-smb devstack@n-api.service[125164]: Host: 10.222.0.26 Oct 24 08:49:13.632037 dv-cinder-master-3-smb devstack@n-api.service[125164]: Openstack-System-Scope: None Oct 24 08:49:13.632037 dv-cinder-master-3-smb devstack@n-api.service[125164]: User-Agent: python-urllib3/1.26.12 Oct 24 08:49:13.632037 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Auth-Token: gAAAAABjVlGDfeDp4-mggGp9coxQ-wSNIfO3JsW5auAiYUMmJXG0KAANmSHflNup8I23tdI-_-j40aI4EKp4T27XK0lFK08nW4xQLnaJSEP3t_A7aEujJecQ-s5XdQfcWuzspG_dw60uWeCytGizO98oyT5JEZRkjI3EmCcvMRwZ2gfFi3PoV3o Oct 24 08:49:13.632037 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Id: None Oct 24 08:49:13.632037 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Name: None Oct 24 08:49:13.632037 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Identity-Status: Confirmed Oct 24 08:49:13.632037 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Is-Admin-Project: True Oct 24 08:49:13.632037 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Id: default Oct 24 08:49:13.632037 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Name: Default Oct 24 08:49:13.632037 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Id: 0001092a700c4a76bbbfd678b6df7e51 Oct 24 08:49:13.632037 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1257941408 Oct 24 08:49:13.632037 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Role: reader,member Oct 24 08:49:13.632037 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Roles: reader,member Oct 24 08:49:13.633262 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0001092a700c4a76bbbfd678b6df7e51", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0001092a700c4a76bbbfd678b6df7e51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0001092a700c4a76bbbfd678b6df7e51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0001092a700c4a76bbbfd678b6df7e51"}]}] Oct 24 08:49:13.633262 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1257941408 Oct 24 08:49:13.633262 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Id: 0001092a700c4a76bbbfd678b6df7e51 Oct 24 08:49:13.633262 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1257941408 Oct 24 08:49:13.633262 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User: tempest-VolumesSnapshotsTestJSON-1257941408-project Oct 24 08:49:13.633262 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Id: default Oct 24 08:49:13.633262 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Name: Default Oct 24 08:49:13.633262 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Id: 365f391239574744be58dc5cd4ef986c Oct 24 08:49:13.633262 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1257941408-project Oct 24 08:49:13.633262 dv-cinder-master-3-smb devstack@n-api.service[125164]: method: Oct 24 08:49:13.633262 dv-cinder-master-3-smb devstack@n-api.service[125164]: exception: Volume 017e1352-5019-4c47-b136-6ebb1c526003 could not be found. Oct 24 08:49:13.633262 dv-cinder-master-3-smb devstack@n-api.service[125164]: action_args: {'id': '017e1352-5019-4c47-b136-6ebb1c526003'} Oct 24 08:49:13.633262 dv-cinder-master-3-smb devstack@n-api.service[125164]: {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:49:13.633954 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:49:13.633954 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 08:49:13.633954 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 08:49:13.633954 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 08:49:13.633954 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 08:49:13.633954 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 08:49:13.633954 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 08:49:13.633954 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 08:49:13.633954 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 08:49:13.633954 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 08:49:13.633954 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 08:49:13.633954 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 08:49:13.633954 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 08:49:13.633954 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 08:49:13.633954 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 08:49:13.633954 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 017e1352-5019-4c47-b136-6ebb1c526003 could not be found. (HTTP 404) (Request-ID: req-a8a96765-a054-4e5d-b358-4727d103ac3b) Oct 24 08:49:13.633954 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:49:13.633954 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:49:13.633954 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:49:13.635049 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:49:13.635049 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 24 08:49:13.635049 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 24 08:49:13.635049 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 08:49:13.635049 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 08:49:13.635049 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 08:49:13.635049 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 08:49:13.635049 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 08:49:13.635049 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 08:49:13.635049 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 08:49:13.635049 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 08:49:13.635049 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 08:49:13.635049 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 08:49:13.635049 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 08:49:13.635049 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 08:49:13.635049 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 08:49:13.635049 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 08:49:13.635049 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 08:49:13.635049 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 08:49:13.636363 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 08:49:13.636363 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 08:49:13.636363 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 08:49:13.636363 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 08:49:13.636363 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 017e1352-5019-4c47-b136-6ebb1c526003 could not be found. Oct 24 08:49:13.636363 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:49:13.636363 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:49:13.636363 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:49:13.636363 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:49:13.636363 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:49:13.636363 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:49:13.636363 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:49:13.636363 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:49:13.636363 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:49:13.636363 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:49:13.636363 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:49:13.636363 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:49:13.636363 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 24 08:49:13.636363 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:49:13.637553 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 017e1352-5019-4c47-b136-6ebb1c526003 could not be found. Oct 24 08:49:13.637553 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:49:13.637553 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:49:13.637553 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:49:13.637553 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:49:13.637553 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:49:13.637553 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:49:13.637553 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:49:13.637553 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:49:13.637553 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 017e1352-5019-4c47-b136-6ebb1c526003 could not be found. Oct 24 08:49:13.637553 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:49:13.638154 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-c9bfced0-6e64-44ab-9204-336f26de1317 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:13.639937 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-f388752f-5d2b-4547-a603-202441a65441 tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] Returning 404 to user: Volume 017e1352-5019-4c47-b136-6ebb1c526003 could not be found. {{(pid=125164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:49:13.640995 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-f388752f-5d2b-4547-a603-202441a65441 tempest-VolumesSnapshotsTestJSON-1257941408 tempest-VolumesSnapshotsTestJSON-1257941408-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/017e1352-5019-4c47-b136-6ebb1c526003" status: 404 len: 109 microversion: 2.1 time: 0.051106 Oct 24 08:49:13.641151 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-c9bfced0-6e64-44ab-9204-336f26de1317 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.231557 Oct 24 08:49:13.642177 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 116/236] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:13 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:13.642630 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 121/237] 10.222.0.26 () {58 vars in 1245 bytes} [Mon Oct 24 08:49:13 2022] GET /compute/v2.1/os-volumes/017e1352-5019-4c47-b136-6ebb1c526003 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 08:49:13.887061 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-2b20ac52-447a-4d91-85c6-560b29eeee62 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:13.887801 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-2b20ac52-447a-4d91-85c6-560b29eeee62 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:13.894441 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2b20ac52-447a-4d91-85c6-560b29eeee62 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:13.896169 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2b20ac52-447a-4d91-85c6-560b29eeee62 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:13.896802 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2b20ac52-447a-4d91-85c6-560b29eeee62 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:13.897698 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2b20ac52-447a-4d91-85c6-560b29eeee62 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:13.898329 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2b20ac52-447a-4d91-85c6-560b29eeee62 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:13.898964 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2b20ac52-447a-4d91-85c6-560b29eeee62 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:13.932389 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-2b20ac52-447a-4d91-85c6-560b29eeee62 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5] Going to try to terminate instance {{(pid=125165) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:49:13.979967 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell1:SELECT=100 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:49:14.039514 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-2b20ac52-447a-4d91-85c6-560b29eeee62 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5" status: 204 len: 0 microversion: 2.1 time: 0.155954 Oct 24 08:49:14.041287 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 117/238] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Oct 24 08:49:13 2022] DELETE /compute/v2.1/servers/2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:49:14.053601 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-2c95d720-900f-4122-a64f-3979a45add04 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:14.054216 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-2c95d720-900f-4122-a64f-3979a45add04 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:14.069541 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2c95d720-900f-4122-a64f-3979a45add04 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:14.073502 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2c95d720-900f-4122-a64f-3979a45add04 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:14.073975 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2c95d720-900f-4122-a64f-3979a45add04 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:14.076817 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2c95d720-900f-4122-a64f-3979a45add04 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:14.077531 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2c95d720-900f-4122-a64f-3979a45add04 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:14.078378 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2c95d720-900f-4122-a64f-3979a45add04 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:14.275731 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-2c95d720-900f-4122-a64f-3979a45add04 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:14.294008 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-2c95d720-900f-4122-a64f-3979a45add04 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5" status: 200 len: 1504 microversion: 2.1 time: 0.246639 Oct 24 08:49:14.295424 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 122/239] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:14 2022] GET /compute/v2.1/servers/2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5 => generated 1504 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:14.667669 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-c684455f-57f2-457b-ac0c-22b0ad520186 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:14.669088 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-c684455f-57f2-457b-ac0c-22b0ad520186 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:14.683204 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c684455f-57f2-457b-ac0c-22b0ad520186 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:14.685752 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c684455f-57f2-457b-ac0c-22b0ad520186 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:14.686407 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c684455f-57f2-457b-ac0c-22b0ad520186 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:14.687934 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c684455f-57f2-457b-ac0c-22b0ad520186 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:14.690652 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c684455f-57f2-457b-ac0c-22b0ad520186 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:14.691399 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c684455f-57f2-457b-ac0c-22b0ad520186 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:14.852556 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-c684455f-57f2-457b-ac0c-22b0ad520186 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:14.862239 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-c684455f-57f2-457b-ac0c-22b0ad520186 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.199532 Oct 24 08:49:14.863445 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 118/240] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:14 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:15.317452 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-93cc08ef-df71-4b84-bba3-673362f0828b tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:15.318121 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-93cc08ef-df71-4b84-bba3-673362f0828b tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:15.324266 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-93cc08ef-df71-4b84-bba3-673362f0828b tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:15.325048 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-93cc08ef-df71-4b84-bba3-673362f0828b tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:15.325488 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-93cc08ef-df71-4b84-bba3-673362f0828b tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:15.326169 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-93cc08ef-df71-4b84-bba3-673362f0828b tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:15.326625 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-93cc08ef-df71-4b84-bba3-673362f0828b tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:15.327062 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-93cc08ef-df71-4b84-bba3-673362f0828b tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:15.494863 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-93cc08ef-df71-4b84-bba3-673362f0828b tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:15.513395 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-93cc08ef-df71-4b84-bba3-673362f0828b tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5" status: 200 len: 1504 microversion: 2.1 time: 0.199719 Oct 24 08:49:15.515982 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 123/241] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:15 2022] GET /compute/v2.1/servers/2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5 => generated 1504 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:15.890261 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-a270baf1-80c1-45e9-bde1-2ec43029ed40 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:15.890907 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-a270baf1-80c1-45e9-bde1-2ec43029ed40 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:15.896804 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-0bc5dea8-debf-464c-970c-3eaf7632c603 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Action: 'create', calling method: .version_select at 0x7f7ef17a98b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1898398287", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwo/zE4+W35X/VW9GqEG4ubJ66WwtBYqazYftLsmqTH9ZBAPinxHrxAPbIHoAI9ZbCxNkDKhz3lQnyt7GcGUmTrqQ7nT/q0XpNl5Xpy1p7Y+PUkyU0244amnKHNDnzl2A=="}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:49:15.897576 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a270baf1-80c1-45e9-bde1-2ec43029ed40 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:15.898143 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a270baf1-80c1-45e9-bde1-2ec43029ed40 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:15.898609 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a270baf1-80c1-45e9-bde1-2ec43029ed40 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:15.899396 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a270baf1-80c1-45e9-bde1-2ec43029ed40 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:15.899786 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a270baf1-80c1-45e9-bde1-2ec43029ed40 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:15.900201 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a270baf1-80c1-45e9-bde1-2ec43029ed40 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:15.913894 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.quota [None req-0bc5dea8-debf-464c-970c-3eaf7632c603 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Getting quotas for project 238b1450574c411682599a39ad0a8371. Resources: {'key_pairs'} {{(pid=125164) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:49:15.920819 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.quota [None req-0bc5dea8-debf-464c-970c-3eaf7632c603 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Getting quotas for user 1aa023d6ce6b45efa086c40c292f4ad0 and project 238b1450574c411682599a39ad0a8371. Resources: {'key_pairs'} {{(pid=125164) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:49:15.944490 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-0bc5dea8-debf-464c-970c-3eaf7632c603 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.051668 Oct 24 08:49:15.945480 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 124/242] 10.222.0.26 () {60 vars in 1159 bytes} [Mon Oct 24 08:49:15 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:49:16.095417 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-270da99a-a8ec-4756-bf3f-0f02792ca344 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-911443821", "imageRef": "9fd4736b-4312-41a0-ac98-3c0fffc62fef", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1898398287", "networks": [{"uuid": "998ef40d-5d26-46b9-a057-0b28c9e33806"}]}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:49:16.155886 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.network.neutron [None req-270da99a-a8ec-4756-bf3f-0f02792ca344 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] validate_networks() for [('998ef40d-5d26-46b9-a057-0b28c9e33806', None, None, None, None, None)] {{(pid=125164) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:49:16.400135 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a270baf1-80c1-45e9-bde1-2ec43029ed40 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:16.408781 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-a270baf1-80c1-45e9-bde1-2ec43029ed40 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.523079 Oct 24 08:49:16.419759 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 119/243] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:15 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:16.539337 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-ba939df2-215e-40f5-a25f-e2b54b05cfa9 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:16.540218 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-ba939df2-215e-40f5-a25f-e2b54b05cfa9 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:16.548312 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ba939df2-215e-40f5-a25f-e2b54b05cfa9 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:16.549028 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ba939df2-215e-40f5-a25f-e2b54b05cfa9 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:16.549618 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ba939df2-215e-40f5-a25f-e2b54b05cfa9 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:16.550471 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ba939df2-215e-40f5-a25f-e2b54b05cfa9 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:16.551738 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ba939df2-215e-40f5-a25f-e2b54b05cfa9 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:16.552529 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ba939df2-215e-40f5-a25f-e2b54b05cfa9 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:16.893352 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-ba939df2-215e-40f5-a25f-e2b54b05cfa9 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:16.902622 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-ba939df2-215e-40f5-a25f-e2b54b05cfa9 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5" status: 200 len: 1504 microversion: 2.1 time: 0.367837 Oct 24 08:49:16.903230 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 120/244] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:16 2022] GET /compute/v2.1/servers/2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5 => generated 1504 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:17.085014 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-270da99a-a8ec-4756-bf3f-0f02792ca344 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Flavor limits 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:49:17.085539 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-270da99a-a8ec-4756-bf3f-0f02792ca344 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Image limits 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:49:17.085887 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-270da99a-a8ec-4756-bf3f-0f02792ca344 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Flavor pref 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:49:17.086307 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-270da99a-a8ec-4756-bf3f-0f02792ca344 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Image pref 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:49:17.087114 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-270da99a-a8ec-4756-bf3f-0f02792ca344 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:49:17.097440 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-270da99a-a8ec-4756-bf3f-0f02792ca344 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:17.098217 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-270da99a-a8ec-4756-bf3f-0f02792ca344 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:17.099043 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-270da99a-a8ec-4756-bf3f-0f02792ca344 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:17.099772 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-270da99a-a8ec-4756-bf3f-0f02792ca344 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:17.100373 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-270da99a-a8ec-4756-bf3f-0f02792ca344 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:17.100793 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-270da99a-a8ec-4756-bf3f-0f02792ca344 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:17.127415 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.quota [None req-270da99a-a8ec-4756-bf3f-0f02792ca344 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Getting quotas for project 238b1450574c411682599a39ad0a8371. Resources: {'ram', 'cores', 'instances'} {{(pid=125164) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:49:17.131937 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.quota [None req-270da99a-a8ec-4756-bf3f-0f02792ca344 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Getting quotas for user 1aa023d6ce6b45efa086c40c292f4ad0 and project 238b1450574c411682599a39ad0a8371. Resources: {'ram', 'cores', 'instances'} {{(pid=125164) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:49:17.143852 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-270da99a-a8ec-4756-bf3f-0f02792ca344 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Going to run 1 instances... {{(pid=125164) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:49:17.147437 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-270da99a-a8ec-4756-bf3f-0f02792ca344 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9fd4736b-4312-41a0-ac98-3c0fffc62fef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125164) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:49:17.219634 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-270da99a-a8ec-4756-bf3f-0f02792ca344 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.131299 Oct 24 08:49:17.228260 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 125/245] 10.222.0.26 () {60 vars in 1147 bytes} [Mon Oct 24 08:49:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1141 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:49:17.232821 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-0f489f56-3ebe-4bd3-9817-cb17a88ccd9f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:17.233627 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-0f489f56-3ebe-4bd3-9817-cb17a88ccd9f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:17.255235 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-2c9eb180-e2e6-4cb7-b323-0861d89f0a3b req-9878c976-df53-430f-b06b-fc0fa6c70a90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5", "name": "network-vif-deleted", "tag": "6e1fcd35-a273-4aa1-b87a-41d8d70dafa2"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:49:17.295255 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-2c9eb180-e2e6-4cb7-b323-0861d89f0a3b req-9878c976-df53-430f-b06b-fc0fa6c70a90 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:17.296248 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-2c9eb180-e2e6-4cb7-b323-0861d89f0a3b req-9878c976-df53-430f-b06b-fc0fa6c70a90 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:17.297104 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-2c9eb180-e2e6-4cb7-b323-0861d89f0a3b req-9878c976-df53-430f-b06b-fc0fa6c70a90 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:17.300172 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-0f489f56-3ebe-4bd3-9817-cb17a88ccd9f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:17.312453 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-0f489f56-3ebe-4bd3-9817-cb17a88ccd9f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1258 microversion: 2.1 time: 0.083576 Oct 24 08:49:17.314576 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 121/246] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:17 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1258 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:49:17.315954 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-2c9eb180-e2e6-4cb7-b323-0861d89f0a3b req-9878c976-df53-430f-b06b-fc0fa6c70a90 service nova] Creating event network-vif-deleted:6e1fcd35-a273-4aa1-b87a-41d8d70dafa2 for instance 2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5 on hv-cinder-maste Oct 24 08:49:17.322902 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-2c9eb180-e2e6-4cb7-b323-0861d89f0a3b req-9878c976-df53-430f-b06b-fc0fa6c70a90 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077741 Oct 24 08:49:17.323717 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 126/247] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:49:17.438179 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-acb1175f-a9dc-4c3d-b56d-b7158c2f4a06 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:17.442425 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-acb1175f-a9dc-4c3d-b56d-b7158c2f4a06 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:17.458880 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-acb1175f-a9dc-4c3d-b56d-b7158c2f4a06 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:17.459584 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-acb1175f-a9dc-4c3d-b56d-b7158c2f4a06 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:17.460220 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-acb1175f-a9dc-4c3d-b56d-b7158c2f4a06 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:17.461497 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-acb1175f-a9dc-4c3d-b56d-b7158c2f4a06 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:17.462113 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-acb1175f-a9dc-4c3d-b56d-b7158c2f4a06 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:17.462856 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-acb1175f-a9dc-4c3d-b56d-b7158c2f4a06 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:17.632514 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-acb1175f-a9dc-4c3d-b56d-b7158c2f4a06 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:17.641128 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-acb1175f-a9dc-4c3d-b56d-b7158c2f4a06 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.212224 Oct 24 08:49:17.655254 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 122/248] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:17 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:17.926738 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-6c4d7b69-1021-4e18-baf2-d7d8306f29f2 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:17.927583 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-6c4d7b69-1021-4e18-baf2-d7d8306f29f2 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:17.933820 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6c4d7b69-1021-4e18-baf2-d7d8306f29f2 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:17.934400 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6c4d7b69-1021-4e18-baf2-d7d8306f29f2 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:17.934854 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6c4d7b69-1021-4e18-baf2-d7d8306f29f2 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:17.935532 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6c4d7b69-1021-4e18-baf2-d7d8306f29f2 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:17.935975 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6c4d7b69-1021-4e18-baf2-d7d8306f29f2 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:17.936392 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6c4d7b69-1021-4e18-baf2-d7d8306f29f2 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:17.967203 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6c4d7b69-1021-4e18-baf2-d7d8306f29f2 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:17.967675 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6c4d7b69-1021-4e18-baf2-d7d8306f29f2 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:17.968097 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6c4d7b69-1021-4e18-baf2-d7d8306f29f2 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:17.968547 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.objects.instance [None req-6c4d7b69-1021-4e18-baf2-d7d8306f29f2 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lazy-loading 'fault' on Instance uuid 2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5 {{(pid=125164) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:49:18.015773 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-6c4d7b69-1021-4e18-baf2-d7d8306f29f2 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:18.023923 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-6c4d7b69-1021-4e18-baf2-d7d8306f29f2 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5" status: 200 len: 1304 microversion: 2.1 time: 0.102023 Oct 24 08:49:18.027060 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 127/249] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:17 2022] GET /compute/v2.1/servers/2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:18.345912 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-71f8c486-b187-4a7a-a648-d5e317afa260 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:18.346524 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-71f8c486-b187-4a7a-a648-d5e317afa260 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:18.352842 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-71f8c486-b187-4a7a-a648-d5e317afa260 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:18.353339 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-71f8c486-b187-4a7a-a648-d5e317afa260 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:18.353775 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-71f8c486-b187-4a7a-a648-d5e317afa260 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:18.354484 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-71f8c486-b187-4a7a-a648-d5e317afa260 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:18.355286 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-71f8c486-b187-4a7a-a648-d5e317afa260 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:18.355970 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-71f8c486-b187-4a7a-a648-d5e317afa260 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:18.437493 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-71f8c486-b187-4a7a-a648-d5e317afa260 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:18.445136 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-71f8c486-b187-4a7a-a648-d5e317afa260 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1310 microversion: 2.1 time: 0.108363 Oct 24 08:49:18.446005 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 123/250] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:18 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1310 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:18.666115 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-e6e8500a-a403-479e-8cf2-7735c2a5e289 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:18.666763 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-e6e8500a-a403-479e-8cf2-7735c2a5e289 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:18.669001 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:49:18.674702 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e6e8500a-a403-479e-8cf2-7735c2a5e289 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:18.675225 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e6e8500a-a403-479e-8cf2-7735c2a5e289 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:18.675651 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e6e8500a-a403-479e-8cf2-7735c2a5e289 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:18.676375 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e6e8500a-a403-479e-8cf2-7735c2a5e289 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:18.676826 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e6e8500a-a403-479e-8cf2-7735c2a5e289 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:18.677249 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e6e8500a-a403-479e-8cf2-7735c2a5e289 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:18.817492 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-e6e8500a-a403-479e-8cf2-7735c2a5e289 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:18.827312 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-e6e8500a-a403-479e-8cf2-7735c2a5e289 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.165720 Oct 24 08:49:18.828012 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 128/251] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:18 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:49:19.048870 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-0808ec0f-a52c-42e5-a4c4-f4c29b2337b6 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:19.049729 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-0808ec0f-a52c-42e5-a4c4-f4c29b2337b6 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:19.055841 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0808ec0f-a52c-42e5-a4c4-f4c29b2337b6 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:19.056316 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0808ec0f-a52c-42e5-a4c4-f4c29b2337b6 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:19.056986 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0808ec0f-a52c-42e5-a4c4-f4c29b2337b6 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:19.057806 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0808ec0f-a52c-42e5-a4c4-f4c29b2337b6 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:19.058438 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0808ec0f-a52c-42e5-a4c4-f4c29b2337b6 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:19.058896 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0808ec0f-a52c-42e5-a4c4-f4c29b2337b6 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:19.073324 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.wsgi [None req-0808ec0f-a52c-42e5-a4c4-f4c29b2337b6 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] HTTP exception thrown: Instance 2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5 could not be found. Oct 24 08:49:19.074910 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-0808ec0f-a52c-42e5-a4c4-f4c29b2337b6 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Request method failure captured: Oct 24 08:49:19.074910 dv-cinder-master-3-smb devstack@n-api.service[125165]: request: GET /compute/v2.1/servers/2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5 HTTP/1.1 Oct 24 08:49:19.074910 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept: application/json Oct 24 08:49:19.074910 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept-Encoding: identity Oct 24 08:49:19.074910 dv-cinder-master-3-smb devstack@n-api.service[125165]: Connection: close Oct 24 08:49:19.074910 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Length: 0 Oct 24 08:49:19.074910 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Type: application/json Oct 24 08:49:19.074910 dv-cinder-master-3-smb devstack@n-api.service[125165]: Host: 10.222.0.26 Oct 24 08:49:19.074910 dv-cinder-master-3-smb devstack@n-api.service[125165]: Openstack-System-Scope: None Oct 24 08:49:19.074910 dv-cinder-master-3-smb devstack@n-api.service[125165]: User-Agent: python-urllib3/1.26.12 Oct 24 08:49:19.074910 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Auth-Token: gAAAAABjVlF14N5Vs64ZxhRYZIc8T_2_EDJOWYos1FmxfUCYhqw5iqsvAYGcDrRimR2StYNsHPHyCRs-C3RHIrRVxW7f5zoB81pTUafvOHzewQslIJT8TYXiaC6CBWhJTCzwKrM3RhYt0tp300Y7lntyX24TOw-VmCzZNsTfuNxZpKlEresyGpY Oct 24 08:49:19.074910 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Id: None Oct 24 08:49:19.074910 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Name: None Oct 24 08:49:19.074910 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Identity-Status: Confirmed Oct 24 08:49:19.074910 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Is-Admin-Project: True Oct 24 08:49:19.074910 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Id: default Oct 24 08:49:19.074910 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Name: Default Oct 24 08:49:19.074910 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Id: c5f2240b2c6a43b8a810d84065ec9d44 Oct 24 08:49:19.074910 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Name: tempest-VolumesActionsTest-1970352770 Oct 24 08:49:19.074910 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Role: reader,member Oct 24 08:49:19.074910 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Roles: reader,member Oct 24 08:49:19.076167 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c5f2240b2c6a43b8a810d84065ec9d44", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c5f2240b2c6a43b8a810d84065ec9d44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5f2240b2c6a43b8a810d84065ec9d44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5f2240b2c6a43b8a810d84065ec9d44"}]}] Oct 24 08:49:19.076167 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant: tempest-VolumesActionsTest-1970352770 Oct 24 08:49:19.076167 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Id: c5f2240b2c6a43b8a810d84065ec9d44 Oct 24 08:49:19.076167 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Name: tempest-VolumesActionsTest-1970352770 Oct 24 08:49:19.076167 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User: tempest-VolumesActionsTest-1970352770-project Oct 24 08:49:19.076167 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Id: default Oct 24 08:49:19.076167 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Name: Default Oct 24 08:49:19.076167 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Id: bee1c05fbfb94433a97928fa2eb5cd15 Oct 24 08:49:19.076167 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Name: tempest-VolumesActionsTest-1970352770-project Oct 24 08:49:19.076167 dv-cinder-master-3-smb devstack@n-api.service[125165]: method: > Oct 24 08:49:19.076167 dv-cinder-master-3-smb devstack@n-api.service[125165]: exception: Instance 2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5 could not be found. Oct 24 08:49:19.076167 dv-cinder-master-3-smb devstack@n-api.service[125165]: action_args: {'id': '2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5'} Oct 24 08:49:19.076951 dv-cinder-master-3-smb devstack@n-api.service[125165]: {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:49:19.076951 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:49:19.076951 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:49:19.076951 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:49:19.076951 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:49:19.076951 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:49:19.076951 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:49:19.076951 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:49:19.076951 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:49:19.076951 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:49:19.076951 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5 could not be found. Oct 24 08:49:19.076951 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:49:19.076951 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:49:19.076951 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:49:19.076951 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:49:19.076951 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:49:19.076951 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:49:19.076951 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:49:19.076951 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:49:19.076951 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:49:19.078232 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:49:19.078232 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:49:19.078232 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:49:19.078232 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:49:19.078232 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:49:19.078232 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:49:19.078232 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:49:19.078232 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5 could not be found. Oct 24 08:49:19.078232 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:49:19.078232 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:49:19.078232 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:49:19.078232 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:49:19.078232 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:49:19.078232 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:49:19.078232 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:49:19.078232 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:49:19.078232 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5 could not be found. Oct 24 08:49:19.078232 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:49:19.082882 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-0808ec0f-a52c-42e5-a4c4-f4c29b2337b6 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Returning 404 to user: Instance 2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5 could not be found. {{(pid=125165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:49:19.084000 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-0808ec0f-a52c-42e5-a4c4-f4c29b2337b6 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5" status: 404 len: 111 microversion: 2.1 time: 0.039166 Oct 24 08:49:19.088134 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 124/252] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:19 2022] GET /compute/v2.1/servers/2aceb6d7-b8d1-4c7c-911b-7f0abdb1dee5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:49:19.207010 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-89dfa900-9c9d-4b9c-9a0e-2d2e1b05c5d7 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-177151180", "imageRef": "7eef2d62-12dc-4746-9cbd-870797d39b4d", "flavorRef": "452", "networks": [{"uuid": "b33af980-7b23-473d-8c46-12025d6a0862"}]}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:49:19.280006 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.network.neutron [None req-89dfa900-9c9d-4b9c-9a0e-2d2e1b05c5d7 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] validate_networks() for [('b33af980-7b23-473d-8c46-12025d6a0862', None, None, None, None, None)] {{(pid=125164) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:49:19.469435 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-f033ddf1-b6f6-4c55-bcc8-ef55d816db57 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:19.470747 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-f033ddf1-b6f6-4c55-bcc8-ef55d816db57 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:19.477617 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f033ddf1-b6f6-4c55-bcc8-ef55d816db57 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:19.478360 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f033ddf1-b6f6-4c55-bcc8-ef55d816db57 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:19.479053 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f033ddf1-b6f6-4c55-bcc8-ef55d816db57 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:19.480035 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f033ddf1-b6f6-4c55-bcc8-ef55d816db57 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:19.480711 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f033ddf1-b6f6-4c55-bcc8-ef55d816db57 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:19.481327 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f033ddf1-b6f6-4c55-bcc8-ef55d816db57 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:19.602576 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-f033ddf1-b6f6-4c55-bcc8-ef55d816db57 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:19.614415 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-f033ddf1-b6f6-4c55-bcc8-ef55d816db57 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1316 microversion: 2.1 time: 0.148866 Oct 24 08:49:19.615524 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 125/253] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:19 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1316 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:19.850196 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-9918b0d9-8df9-48b3-ac1b-43077c9e1b69 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:19.850843 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-9918b0d9-8df9-48b3-ac1b-43077c9e1b69 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:19.860718 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9918b0d9-8df9-48b3-ac1b-43077c9e1b69 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:19.861323 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9918b0d9-8df9-48b3-ac1b-43077c9e1b69 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:19.861757 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9918b0d9-8df9-48b3-ac1b-43077c9e1b69 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:19.862792 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9918b0d9-8df9-48b3-ac1b-43077c9e1b69 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:19.863288 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9918b0d9-8df9-48b3-ac1b-43077c9e1b69 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:19.863985 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9918b0d9-8df9-48b3-ac1b-43077c9e1b69 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:19.903496 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-89dfa900-9c9d-4b9c-9a0e-2d2e1b05c5d7 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Flavor limits 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:49:19.908650 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-89dfa900-9c9d-4b9c-9a0e-2d2e1b05c5d7 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Image limits 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:49:19.909262 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-89dfa900-9c9d-4b9c-9a0e-2d2e1b05c5d7 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Flavor pref 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:49:19.909790 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-89dfa900-9c9d-4b9c-9a0e-2d2e1b05c5d7 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Image pref 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:49:19.910400 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-89dfa900-9c9d-4b9c-9a0e-2d2e1b05c5d7 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:49:19.923311 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-89dfa900-9c9d-4b9c-9a0e-2d2e1b05c5d7 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:19.924357 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-89dfa900-9c9d-4b9c-9a0e-2d2e1b05c5d7 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:19.925519 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-89dfa900-9c9d-4b9c-9a0e-2d2e1b05c5d7 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:19.926624 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-89dfa900-9c9d-4b9c-9a0e-2d2e1b05c5d7 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:19.927270 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-89dfa900-9c9d-4b9c-9a0e-2d2e1b05c5d7 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:19.927867 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-89dfa900-9c9d-4b9c-9a0e-2d2e1b05c5d7 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:19.949813 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.quota [None req-89dfa900-9c9d-4b9c-9a0e-2d2e1b05c5d7 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Getting quotas for project c5f2240b2c6a43b8a810d84065ec9d44. Resources: {'ram', 'cores', 'instances'} {{(pid=125164) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:49:19.955101 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.quota [None req-89dfa900-9c9d-4b9c-9a0e-2d2e1b05c5d7 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Getting quotas for user bee1c05fbfb94433a97928fa2eb5cd15 and project c5f2240b2c6a43b8a810d84065ec9d44. Resources: {'ram', 'cores', 'instances'} {{(pid=125164) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:49:19.989883 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-89dfa900-9c9d-4b9c-9a0e-2d2e1b05c5d7 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Going to run 1 instances... {{(pid=125164) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:49:20.001609 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-89dfa900-9c9d-4b9c-9a0e-2d2e1b05c5d7 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7eef2d62-12dc-4746-9cbd-870797d39b4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125164) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:49:20.088915 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-9918b0d9-8df9-48b3-ac1b-43077c9e1b69 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:20.105696 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-89dfa900-9c9d-4b9c-9a0e-2d2e1b05c5d7 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.904019 Oct 24 08:49:20.106963 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 129/254] 10.222.0.26 () {60 vars in 1147 bytes} [Mon Oct 24 08:49:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:49:20.119798 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-ce10af62-1807-498c-9b13-a34ce76b5293 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:20.120546 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-9918b0d9-8df9-48b3-ac1b-43077c9e1b69 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.273522 Oct 24 08:49:20.121147 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-ce10af62-1807-498c-9b13-a34ce76b5293 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:20.134753 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 126/255] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:19 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:20.330141 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-ce10af62-1807-498c-9b13-a34ce76b5293 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:20.345873 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-ce10af62-1807-498c-9b13-a34ce76b5293 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1213 microversion: 2.1 time: 0.229126 Oct 24 08:49:20.349513 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 130/256] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:20 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1213 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:20.641043 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-e08e389f-5232-40d9-a91b-41394dd02db1 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:20.642283 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-e08e389f-5232-40d9-a91b-41394dd02db1 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:20.650140 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e08e389f-5232-40d9-a91b-41394dd02db1 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:20.651134 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e08e389f-5232-40d9-a91b-41394dd02db1 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:20.651789 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e08e389f-5232-40d9-a91b-41394dd02db1 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:20.652872 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e08e389f-5232-40d9-a91b-41394dd02db1 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:20.653543 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e08e389f-5232-40d9-a91b-41394dd02db1 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:20.654176 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e08e389f-5232-40d9-a91b-41394dd02db1 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:20.897090 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-e08e389f-5232-40d9-a91b-41394dd02db1 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:20.909428 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-e08e389f-5232-40d9-a91b-41394dd02db1 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1358 microversion: 2.1 time: 0.273614 Oct 24 08:49:20.911916 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 127/257] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:20 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1358 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:21.152622 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-edb75263-d83c-4aa5-a30b-cf604df0dbb0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:21.153980 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-edb75263-d83c-4aa5-a30b-cf604df0dbb0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:21.160767 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-edb75263-d83c-4aa5-a30b-cf604df0dbb0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:21.161501 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-edb75263-d83c-4aa5-a30b-cf604df0dbb0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:21.162099 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-edb75263-d83c-4aa5-a30b-cf604df0dbb0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:21.162991 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-edb75263-d83c-4aa5-a30b-cf604df0dbb0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:21.163613 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-edb75263-d83c-4aa5-a30b-cf604df0dbb0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:21.164421 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-edb75263-d83c-4aa5-a30b-cf604df0dbb0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:21.350649 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-edb75263-d83c-4aa5-a30b-cf604df0dbb0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:21.359398 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-edb75263-d83c-4aa5-a30b-cf604df0dbb0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.210841 Oct 24 08:49:21.360063 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 131/258] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:21 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:21.372945 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-ecfb45c2-b19d-4b3d-b579-dcfe5cf82a85 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:21.373843 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-ecfb45c2-b19d-4b3d-b579-dcfe5cf82a85 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:21.380884 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ecfb45c2-b19d-4b3d-b579-dcfe5cf82a85 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:21.381363 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ecfb45c2-b19d-4b3d-b579-dcfe5cf82a85 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:21.381794 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ecfb45c2-b19d-4b3d-b579-dcfe5cf82a85 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:21.382518 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ecfb45c2-b19d-4b3d-b579-dcfe5cf82a85 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:21.383034 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ecfb45c2-b19d-4b3d-b579-dcfe5cf82a85 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:21.383449 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ecfb45c2-b19d-4b3d-b579-dcfe5cf82a85 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:21.530353 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-ecfb45c2-b19d-4b3d-b579-dcfe5cf82a85 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:21.547457 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-ecfb45c2-b19d-4b3d-b579-dcfe5cf82a85 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1217 microversion: 2.1 time: 0.178982 Oct 24 08:49:21.548563 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 128/259] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:21 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1217 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:21.948561 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-237dd8d7-ed6e-4fcd-9a49-3c8604e5694c tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:21.949297 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-237dd8d7-ed6e-4fcd-9a49-3c8604e5694c tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:21.955785 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-237dd8d7-ed6e-4fcd-9a49-3c8604e5694c tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:21.956266 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-237dd8d7-ed6e-4fcd-9a49-3c8604e5694c tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:21.956702 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-237dd8d7-ed6e-4fcd-9a49-3c8604e5694c tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:21.957430 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-237dd8d7-ed6e-4fcd-9a49-3c8604e5694c tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:21.957882 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-237dd8d7-ed6e-4fcd-9a49-3c8604e5694c tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:21.958306 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-237dd8d7-ed6e-4fcd-9a49-3c8604e5694c tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:22.106962 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-237dd8d7-ed6e-4fcd-9a49-3c8604e5694c tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:22.114851 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-237dd8d7-ed6e-4fcd-9a49-3c8604e5694c tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1358 microversion: 2.1 time: 0.170305 Oct 24 08:49:22.115463 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 132/260] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:21 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:22.388597 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-cffd6a5e-0f8d-42b7-9d40-8b972a9c5e84 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:22.390145 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-cffd6a5e-0f8d-42b7-9d40-8b972a9c5e84 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:22.397589 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cffd6a5e-0f8d-42b7-9d40-8b972a9c5e84 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:22.398408 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cffd6a5e-0f8d-42b7-9d40-8b972a9c5e84 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:22.398984 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cffd6a5e-0f8d-42b7-9d40-8b972a9c5e84 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:22.400111 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cffd6a5e-0f8d-42b7-9d40-8b972a9c5e84 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:22.400757 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cffd6a5e-0f8d-42b7-9d40-8b972a9c5e84 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:22.401256 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cffd6a5e-0f8d-42b7-9d40-8b972a9c5e84 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:22.542115 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-cffd6a5e-0f8d-42b7-9d40-8b972a9c5e84 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:22.551556 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-cffd6a5e-0f8d-42b7-9d40-8b972a9c5e84 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.167996 Oct 24 08:49:22.552394 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 129/261] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:22 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:22.572416 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-6a92bf34-27e6-4f5a-bf18-90c7fd29d42d tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:22.573043 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-6a92bf34-27e6-4f5a-bf18-90c7fd29d42d tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:22.580209 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6a92bf34-27e6-4f5a-bf18-90c7fd29d42d tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:22.580714 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6a92bf34-27e6-4f5a-bf18-90c7fd29d42d tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:22.581157 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6a92bf34-27e6-4f5a-bf18-90c7fd29d42d tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:22.581876 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6a92bf34-27e6-4f5a-bf18-90c7fd29d42d tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:22.582374 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6a92bf34-27e6-4f5a-bf18-90c7fd29d42d tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:22.582856 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6a92bf34-27e6-4f5a-bf18-90c7fd29d42d tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:22.681279 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-6a92bf34-27e6-4f5a-bf18-90c7fd29d42d tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:22.691417 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-6a92bf34-27e6-4f5a-bf18-90c7fd29d42d tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1217 microversion: 2.1 time: 0.123254 Oct 24 08:49:22.692153 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 133/262] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:22 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1217 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:23.138081 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-a3360e5d-a1ca-410c-87e9-6f8060def11b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:23.138681 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-a3360e5d-a1ca-410c-87e9-6f8060def11b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:23.145028 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a3360e5d-a1ca-410c-87e9-6f8060def11b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:23.145508 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a3360e5d-a1ca-410c-87e9-6f8060def11b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:23.145933 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a3360e5d-a1ca-410c-87e9-6f8060def11b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:23.146618 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a3360e5d-a1ca-410c-87e9-6f8060def11b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:23.147094 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a3360e5d-a1ca-410c-87e9-6f8060def11b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:23.147511 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a3360e5d-a1ca-410c-87e9-6f8060def11b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:23.288380 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a3360e5d-a1ca-410c-87e9-6f8060def11b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:23.297083 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-a3360e5d-a1ca-410c-87e9-6f8060def11b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1358 microversion: 2.1 time: 0.163041 Oct 24 08:49:23.298001 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 130/263] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:23 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:23.579803 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-eff83beb-62ee-422f-9323-e83b27d0441e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:23.580439 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-eff83beb-62ee-422f-9323-e83b27d0441e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:23.587520 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-eff83beb-62ee-422f-9323-e83b27d0441e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:23.587994 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-eff83beb-62ee-422f-9323-e83b27d0441e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:23.588522 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-eff83beb-62ee-422f-9323-e83b27d0441e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:23.589389 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-eff83beb-62ee-422f-9323-e83b27d0441e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:23.589677 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-eff83beb-62ee-422f-9323-e83b27d0441e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:23.590103 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-eff83beb-62ee-422f-9323-e83b27d0441e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:23.610558 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell1:SELECT=100 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:49:23.713946 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-0798b254-14db-45ca-9475-a58b6850fd30 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:23.715274 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-0798b254-14db-45ca-9475-a58b6850fd30 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:23.725437 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0798b254-14db-45ca-9475-a58b6850fd30 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:23.725926 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0798b254-14db-45ca-9475-a58b6850fd30 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:23.726360 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0798b254-14db-45ca-9475-a58b6850fd30 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:23.727090 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0798b254-14db-45ca-9475-a58b6850fd30 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:23.727542 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0798b254-14db-45ca-9475-a58b6850fd30 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:23.727960 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0798b254-14db-45ca-9475-a58b6850fd30 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:23.755775 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-eff83beb-62ee-422f-9323-e83b27d0441e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:23.763610 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-eff83beb-62ee-422f-9323-e83b27d0441e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.187785 Oct 24 08:49:23.764185 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 134/264] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:23 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:23.794705 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-0798b254-14db-45ca-9475-a58b6850fd30 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:23.804725 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-0798b254-14db-45ca-9475-a58b6850fd30 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1217 microversion: 2.1 time: 0.094680 Oct 24 08:49:23.805757 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 131/265] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:23 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:24.321656 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-5cf9630a-7596-49e6-9a58-abb84fba62e2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:24.322506 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-5cf9630a-7596-49e6-9a58-abb84fba62e2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:24.329627 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5cf9630a-7596-49e6-9a58-abb84fba62e2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:24.330200 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5cf9630a-7596-49e6-9a58-abb84fba62e2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:24.330693 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5cf9630a-7596-49e6-9a58-abb84fba62e2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:24.331480 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5cf9630a-7596-49e6-9a58-abb84fba62e2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:24.331922 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5cf9630a-7596-49e6-9a58-abb84fba62e2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:24.332339 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5cf9630a-7596-49e6-9a58-abb84fba62e2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:24.505270 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-5cf9630a-7596-49e6-9a58-abb84fba62e2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:24.515076 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-5cf9630a-7596-49e6-9a58-abb84fba62e2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1358 microversion: 2.1 time: 0.197838 Oct 24 08:49:24.515761 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 135/266] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:24 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:24.786362 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-6b7e3b6f-1291-41c3-90b8-939412d8c084 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:24.786968 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-6b7e3b6f-1291-41c3-90b8-939412d8c084 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:24.793472 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6b7e3b6f-1291-41c3-90b8-939412d8c084 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:24.793964 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6b7e3b6f-1291-41c3-90b8-939412d8c084 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:24.794399 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6b7e3b6f-1291-41c3-90b8-939412d8c084 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:24.795108 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6b7e3b6f-1291-41c3-90b8-939412d8c084 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:24.795552 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6b7e3b6f-1291-41c3-90b8-939412d8c084 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:24.795967 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6b7e3b6f-1291-41c3-90b8-939412d8c084 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:24.828600 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-68c5649e-9706-4d9a-a9af-da1186c20f71 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:24.829304 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-68c5649e-9706-4d9a-a9af-da1186c20f71 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:24.836037 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-68c5649e-9706-4d9a-a9af-da1186c20f71 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:24.836529 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-68c5649e-9706-4d9a-a9af-da1186c20f71 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:24.836962 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-68c5649e-9706-4d9a-a9af-da1186c20f71 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:24.837660 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-68c5649e-9706-4d9a-a9af-da1186c20f71 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:24.838112 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-68c5649e-9706-4d9a-a9af-da1186c20f71 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:24.838532 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-68c5649e-9706-4d9a-a9af-da1186c20f71 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:24.912938 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-68c5649e-9706-4d9a-a9af-da1186c20f71 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:24.926407 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-68c5649e-9706-4d9a-a9af-da1186c20f71 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1217 microversion: 2.1 time: 0.101673 Oct 24 08:49:24.927163 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 136/267] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:24 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:49:24.984737 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-6b7e3b6f-1291-41c3-90b8-939412d8c084 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:25.003553 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-6b7e3b6f-1291-41c3-90b8-939412d8c084 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.221299 Oct 24 08:49:25.009229 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 132/268] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:24 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:25.537914 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-43b9b71c-eeff-4037-8fa1-c5f487c44b2a tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:25.538802 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-43b9b71c-eeff-4037-8fa1-c5f487c44b2a tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:25.545871 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-43b9b71c-eeff-4037-8fa1-c5f487c44b2a tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:25.546623 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-43b9b71c-eeff-4037-8fa1-c5f487c44b2a tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:25.550544 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-43b9b71c-eeff-4037-8fa1-c5f487c44b2a tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:25.551374 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-43b9b71c-eeff-4037-8fa1-c5f487c44b2a tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:25.551840 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-43b9b71c-eeff-4037-8fa1-c5f487c44b2a tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:25.552261 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-43b9b71c-eeff-4037-8fa1-c5f487c44b2a tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:25.716640 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-43b9b71c-eeff-4037-8fa1-c5f487c44b2a tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:25.724970 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-43b9b71c-eeff-4037-8fa1-c5f487c44b2a tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1358 microversion: 2.1 time: 0.191294 Oct 24 08:49:25.725537 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 137/269] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:25 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:25.949605 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-55ae4c6d-efbd-4edd-a084-156b1a90e1d6 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:25.950270 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-55ae4c6d-efbd-4edd-a084-156b1a90e1d6 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:25.956229 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-55ae4c6d-efbd-4edd-a084-156b1a90e1d6 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:25.956693 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-55ae4c6d-efbd-4edd-a084-156b1a90e1d6 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:25.957117 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-55ae4c6d-efbd-4edd-a084-156b1a90e1d6 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:25.957788 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-55ae4c6d-efbd-4edd-a084-156b1a90e1d6 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:25.958293 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-55ae4c6d-efbd-4edd-a084-156b1a90e1d6 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:25.958705 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-55ae4c6d-efbd-4edd-a084-156b1a90e1d6 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:26.018972 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-55ae4c6d-efbd-4edd-a084-156b1a90e1d6 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:26.026015 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-dd7ebb44-d5e3-4d28-bc97-b5beb4520fd2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:26.026627 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-dd7ebb44-d5e3-4d28-bc97-b5beb4520fd2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:26.027497 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-55ae4c6d-efbd-4edd-a084-156b1a90e1d6 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1217 microversion: 2.1 time: 0.081944 Oct 24 08:49:26.028054 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 133/270] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:25 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:26.034224 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-dd7ebb44-d5e3-4d28-bc97-b5beb4520fd2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:26.034737 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-dd7ebb44-d5e3-4d28-bc97-b5beb4520fd2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:26.035191 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-dd7ebb44-d5e3-4d28-bc97-b5beb4520fd2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:26.035882 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-dd7ebb44-d5e3-4d28-bc97-b5beb4520fd2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:26.036452 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-dd7ebb44-d5e3-4d28-bc97-b5beb4520fd2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:26.036856 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-dd7ebb44-d5e3-4d28-bc97-b5beb4520fd2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:26.191641 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-dd7ebb44-d5e3-4d28-bc97-b5beb4520fd2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:26.199847 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-dd7ebb44-d5e3-4d28-bc97-b5beb4520fd2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.177669 Oct 24 08:49:26.200414 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 138/271] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:26 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:49:26.751169 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-9241cda3-dded-4f0d-b4ef-d34794b26132 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:26.752700 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-9241cda3-dded-4f0d-b4ef-d34794b26132 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:26.765649 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9241cda3-dded-4f0d-b4ef-d34794b26132 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:26.766585 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9241cda3-dded-4f0d-b4ef-d34794b26132 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:26.767357 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9241cda3-dded-4f0d-b4ef-d34794b26132 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:26.768669 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9241cda3-dded-4f0d-b4ef-d34794b26132 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:26.769398 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9241cda3-dded-4f0d-b4ef-d34794b26132 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:26.770306 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9241cda3-dded-4f0d-b4ef-d34794b26132 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:26.919070 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-9241cda3-dded-4f0d-b4ef-d34794b26132 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:26.923967 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-9241cda3-dded-4f0d-b4ef-d34794b26132 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1358 microversion: 2.1 time: 0.176246 Oct 24 08:49:26.923967 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 134/272] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:26 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:27.051170 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-37b52e9f-6b80-45f8-b1ec-fb3c5f6b4460 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:27.051794 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-37b52e9f-6b80-45f8-b1ec-fb3c5f6b4460 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:27.059374 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-37b52e9f-6b80-45f8-b1ec-fb3c5f6b4460 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:27.059911 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-37b52e9f-6b80-45f8-b1ec-fb3c5f6b4460 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:27.060370 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-37b52e9f-6b80-45f8-b1ec-fb3c5f6b4460 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:27.061233 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-37b52e9f-6b80-45f8-b1ec-fb3c5f6b4460 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:27.061743 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-37b52e9f-6b80-45f8-b1ec-fb3c5f6b4460 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:27.062270 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-37b52e9f-6b80-45f8-b1ec-fb3c5f6b4460 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:27.145540 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-37b52e9f-6b80-45f8-b1ec-fb3c5f6b4460 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:27.153586 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-37b52e9f-6b80-45f8-b1ec-fb3c5f6b4460 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1217 microversion: 2.1 time: 0.106270 Oct 24 08:49:27.154364 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 139/273] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:27 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1217 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:27.225241 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-c04d58f3-ef6a-49a9-b43f-9c351c0a2164 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:27.225949 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-c04d58f3-ef6a-49a9-b43f-9c351c0a2164 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:27.235264 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c04d58f3-ef6a-49a9-b43f-9c351c0a2164 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:27.236097 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c04d58f3-ef6a-49a9-b43f-9c351c0a2164 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:27.236748 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c04d58f3-ef6a-49a9-b43f-9c351c0a2164 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:27.237874 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c04d58f3-ef6a-49a9-b43f-9c351c0a2164 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:27.238468 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c04d58f3-ef6a-49a9-b43f-9c351c0a2164 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:27.239456 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c04d58f3-ef6a-49a9-b43f-9c351c0a2164 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:27.242534 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:49:27.308527 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell0:SELECT=2 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:49:27.378501 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-c04d58f3-ef6a-49a9-b43f-9c351c0a2164 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:27.386796 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-c04d58f3-ef6a-49a9-b43f-9c351c0a2164 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.167450 Oct 24 08:49:27.403559 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 135/274] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:27 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:27.945481 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-8e7e2b0a-d5e5-4869-994d-21f5f6160294 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:27.946214 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-8e7e2b0a-d5e5-4869-994d-21f5f6160294 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:27.953119 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8e7e2b0a-d5e5-4869-994d-21f5f6160294 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:27.953632 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8e7e2b0a-d5e5-4869-994d-21f5f6160294 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:27.954159 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8e7e2b0a-d5e5-4869-994d-21f5f6160294 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:27.954907 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8e7e2b0a-d5e5-4869-994d-21f5f6160294 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:27.955361 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8e7e2b0a-d5e5-4869-994d-21f5f6160294 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:27.955781 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8e7e2b0a-d5e5-4869-994d-21f5f6160294 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:28.095752 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-8e7e2b0a-d5e5-4869-994d-21f5f6160294 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:28.104189 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-8e7e2b0a-d5e5-4869-994d-21f5f6160294 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1358 microversion: 2.1 time: 0.162689 Oct 24 08:49:28.104941 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 140/275] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:27 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:28.177831 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-790628e1-bd4e-4d5f-995d-6759ff51d103 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:28.178445 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-790628e1-bd4e-4d5f-995d-6759ff51d103 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:28.184869 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-790628e1-bd4e-4d5f-995d-6759ff51d103 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:28.185355 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-790628e1-bd4e-4d5f-995d-6759ff51d103 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:28.185792 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-790628e1-bd4e-4d5f-995d-6759ff51d103 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:28.186480 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-790628e1-bd4e-4d5f-995d-6759ff51d103 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:28.186971 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-790628e1-bd4e-4d5f-995d-6759ff51d103 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:28.187392 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-790628e1-bd4e-4d5f-995d-6759ff51d103 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:28.259787 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-790628e1-bd4e-4d5f-995d-6759ff51d103 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:28.267929 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-790628e1-bd4e-4d5f-995d-6759ff51d103 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1217 microversion: 2.1 time: 0.094068 Oct 24 08:49:28.268698 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 136/276] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:28 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:28.413022 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-3630eaf4-00ea-493f-b2e5-3659ff056b1a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:28.413641 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-3630eaf4-00ea-493f-b2e5-3659ff056b1a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:28.420120 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3630eaf4-00ea-493f-b2e5-3659ff056b1a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:28.420812 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3630eaf4-00ea-493f-b2e5-3659ff056b1a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:28.421240 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3630eaf4-00ea-493f-b2e5-3659ff056b1a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:28.422123 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3630eaf4-00ea-493f-b2e5-3659ff056b1a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:28.422634 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3630eaf4-00ea-493f-b2e5-3659ff056b1a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:28.423086 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3630eaf4-00ea-493f-b2e5-3659ff056b1a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:28.816312 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-3630eaf4-00ea-493f-b2e5-3659ff056b1a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:28.824391 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-3630eaf4-00ea-493f-b2e5-3659ff056b1a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.416653 Oct 24 08:49:28.824942 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 141/277] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:28 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:29.128533 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-1a9b23e2-0d11-4759-b5bc-989eda7b1961 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:29.129156 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-1a9b23e2-0d11-4759-b5bc-989eda7b1961 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:29.135723 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1a9b23e2-0d11-4759-b5bc-989eda7b1961 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:29.136207 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1a9b23e2-0d11-4759-b5bc-989eda7b1961 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:29.136638 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1a9b23e2-0d11-4759-b5bc-989eda7b1961 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:29.137323 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1a9b23e2-0d11-4759-b5bc-989eda7b1961 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:29.137775 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1a9b23e2-0d11-4759-b5bc-989eda7b1961 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:29.138195 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1a9b23e2-0d11-4759-b5bc-989eda7b1961 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:29.281438 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-1a9b23e2-0d11-4759-b5bc-989eda7b1961 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:29.291857 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-b09bbc9c-b98f-4aaa-95f3-d657f171f27e tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:29.293094 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-b09bbc9c-b98f-4aaa-95f3-d657f171f27e tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:29.296061 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-1a9b23e2-0d11-4759-b5bc-989eda7b1961 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1358 microversion: 2.1 time: 0.171420 Oct 24 08:49:29.296947 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 137/278] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:29 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:29.303987 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b09bbc9c-b98f-4aaa-95f3-d657f171f27e tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:29.304485 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b09bbc9c-b98f-4aaa-95f3-d657f171f27e tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:29.304923 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b09bbc9c-b98f-4aaa-95f3-d657f171f27e tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:29.305626 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b09bbc9c-b98f-4aaa-95f3-d657f171f27e tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:29.310585 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b09bbc9c-b98f-4aaa-95f3-d657f171f27e tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:29.311137 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b09bbc9c-b98f-4aaa-95f3-d657f171f27e tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:29.374524 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-b09bbc9c-b98f-4aaa-95f3-d657f171f27e tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:29.382273 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-b09bbc9c-b98f-4aaa-95f3-d657f171f27e tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1217 microversion: 2.1 time: 0.094954 Oct 24 08:49:29.382886 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 142/279] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:29 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:49:29.847776 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-5fcdd383-3968-4d6f-b422-7c4f7aeee285 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:29.848401 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-5fcdd383-3968-4d6f-b422-7c4f7aeee285 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:29.854830 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5fcdd383-3968-4d6f-b422-7c4f7aeee285 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:29.855328 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5fcdd383-3968-4d6f-b422-7c4f7aeee285 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:29.855758 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5fcdd383-3968-4d6f-b422-7c4f7aeee285 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:29.856452 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5fcdd383-3968-4d6f-b422-7c4f7aeee285 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:29.856897 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5fcdd383-3968-4d6f-b422-7c4f7aeee285 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:29.857457 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5fcdd383-3968-4d6f-b422-7c4f7aeee285 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:29.996654 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-5fcdd383-3968-4d6f-b422-7c4f7aeee285 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:30.004462 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-5fcdd383-3968-4d6f-b422-7c4f7aeee285 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.160851 Oct 24 08:49:30.005033 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 138/280] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:29 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:30.319637 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-057d0dc0-0c7c-4384-b709-d62e467ccda2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:30.320203 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-057d0dc0-0c7c-4384-b709-d62e467ccda2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:30.321999 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell0:SELECT=4 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:49:30.327816 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-057d0dc0-0c7c-4384-b709-d62e467ccda2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:30.328293 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-057d0dc0-0c7c-4384-b709-d62e467ccda2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:30.328722 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-057d0dc0-0c7c-4384-b709-d62e467ccda2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:30.329393 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-057d0dc0-0c7c-4384-b709-d62e467ccda2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:30.329835 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-057d0dc0-0c7c-4384-b709-d62e467ccda2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:30.330248 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-057d0dc0-0c7c-4384-b709-d62e467ccda2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:30.344685 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell0:SELECT=18 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:49:30.405224 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-ed9208c4-0704-4eff-8b21-3aaf5d395fae tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:30.405832 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-ed9208c4-0704-4eff-8b21-3aaf5d395fae tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:30.411895 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ed9208c4-0704-4eff-8b21-3aaf5d395fae tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:30.412370 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ed9208c4-0704-4eff-8b21-3aaf5d395fae tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:30.412794 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ed9208c4-0704-4eff-8b21-3aaf5d395fae tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:30.413468 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ed9208c4-0704-4eff-8b21-3aaf5d395fae tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:30.413910 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ed9208c4-0704-4eff-8b21-3aaf5d395fae tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:30.414321 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ed9208c4-0704-4eff-8b21-3aaf5d395fae tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:30.465492 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-057d0dc0-0c7c-4384-b709-d62e467ccda2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:30.473499 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-057d0dc0-0c7c-4384-b709-d62e467ccda2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1358 microversion: 2.1 time: 0.157785 Oct 24 08:49:30.474131 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 143/281] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:30 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:30.509645 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-ed9208c4-0704-4eff-8b21-3aaf5d395fae tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:30.519941 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-ed9208c4-0704-4eff-8b21-3aaf5d395fae tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1217 microversion: 2.1 time: 0.118535 Oct 24 08:49:30.522631 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 139/282] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:30 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1217 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:31.028069 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-40aa9b3f-f693-4bd4-a739-f46568fc1f85 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:31.028692 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-40aa9b3f-f693-4bd4-a739-f46568fc1f85 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:31.037574 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-40aa9b3f-f693-4bd4-a739-f46568fc1f85 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:31.038413 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-40aa9b3f-f693-4bd4-a739-f46568fc1f85 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:31.038935 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-40aa9b3f-f693-4bd4-a739-f46568fc1f85 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:31.039744 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-40aa9b3f-f693-4bd4-a739-f46568fc1f85 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:31.040263 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-40aa9b3f-f693-4bd4-a739-f46568fc1f85 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:31.041086 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-40aa9b3f-f693-4bd4-a739-f46568fc1f85 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:31.189796 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-40aa9b3f-f693-4bd4-a739-f46568fc1f85 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:31.198335 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-40aa9b3f-f693-4bd4-a739-f46568fc1f85 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.174398 Oct 24 08:49:31.199070 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 144/283] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:31 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:31.498436 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-1fac883c-52b8-448f-9ee4-cb0802085443 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:31.499305 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-1fac883c-52b8-448f-9ee4-cb0802085443 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:31.506292 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1fac883c-52b8-448f-9ee4-cb0802085443 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:31.507097 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1fac883c-52b8-448f-9ee4-cb0802085443 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:31.507723 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1fac883c-52b8-448f-9ee4-cb0802085443 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:31.508617 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1fac883c-52b8-448f-9ee4-cb0802085443 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:31.509193 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1fac883c-52b8-448f-9ee4-cb0802085443 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:31.509889 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1fac883c-52b8-448f-9ee4-cb0802085443 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:31.543789 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-a54454d0-2452-4002-961f-0c83f1bbfee3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:31.544494 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-a54454d0-2452-4002-961f-0c83f1bbfee3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:31.551234 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a54454d0-2452-4002-961f-0c83f1bbfee3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:31.551720 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a54454d0-2452-4002-961f-0c83f1bbfee3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:31.552262 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a54454d0-2452-4002-961f-0c83f1bbfee3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:31.553002 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a54454d0-2452-4002-961f-0c83f1bbfee3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:31.553452 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a54454d0-2452-4002-961f-0c83f1bbfee3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:31.553870 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a54454d0-2452-4002-961f-0c83f1bbfee3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:31.632225 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-a54454d0-2452-4002-961f-0c83f1bbfee3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:31.640935 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-a54454d0-2452-4002-961f-0c83f1bbfee3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1217 microversion: 2.1 time: 0.101211 Oct 24 08:49:31.642038 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 145/284] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:31 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:31.690003 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-1fac883c-52b8-448f-9ee4-cb0802085443 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:31.697642 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-1fac883c-52b8-448f-9ee4-cb0802085443 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1358 microversion: 2.1 time: 0.203861 Oct 24 08:49:31.698206 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 140/285] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:31 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:32.225756 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-5cfc5f21-f12b-4ec8-a7a1-9903864eb70c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:32.226387 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-5cfc5f21-f12b-4ec8-a7a1-9903864eb70c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:32.232810 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5cfc5f21-f12b-4ec8-a7a1-9903864eb70c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:32.233297 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5cfc5f21-f12b-4ec8-a7a1-9903864eb70c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:32.233724 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5cfc5f21-f12b-4ec8-a7a1-9903864eb70c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:32.234429 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5cfc5f21-f12b-4ec8-a7a1-9903864eb70c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:32.235047 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5cfc5f21-f12b-4ec8-a7a1-9903864eb70c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:32.235502 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5cfc5f21-f12b-4ec8-a7a1-9903864eb70c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:32.372477 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-5cfc5f21-f12b-4ec8-a7a1-9903864eb70c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:32.380716 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-5cfc5f21-f12b-4ec8-a7a1-9903864eb70c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.159039 Oct 24 08:49:32.381312 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 146/286] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:32 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:32.669615 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-c667c0ef-156b-42de-bb53-b40650f715f1 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:32.670516 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-c667c0ef-156b-42de-bb53-b40650f715f1 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:32.679684 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c667c0ef-156b-42de-bb53-b40650f715f1 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:32.680169 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c667c0ef-156b-42de-bb53-b40650f715f1 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:32.680603 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c667c0ef-156b-42de-bb53-b40650f715f1 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:32.681293 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c667c0ef-156b-42de-bb53-b40650f715f1 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:32.681731 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c667c0ef-156b-42de-bb53-b40650f715f1 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:32.682154 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c667c0ef-156b-42de-bb53-b40650f715f1 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:32.720728 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-cbbfd8e5-097a-4358-9532-ab15fd868e6a tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:32.721332 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-cbbfd8e5-097a-4358-9532-ab15fd868e6a tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:32.728206 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cbbfd8e5-097a-4358-9532-ab15fd868e6a tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:32.728691 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cbbfd8e5-097a-4358-9532-ab15fd868e6a tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:32.729111 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cbbfd8e5-097a-4358-9532-ab15fd868e6a tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:32.729803 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cbbfd8e5-097a-4358-9532-ab15fd868e6a tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:32.730247 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cbbfd8e5-097a-4358-9532-ab15fd868e6a tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:32.730663 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cbbfd8e5-097a-4358-9532-ab15fd868e6a tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:32.742994 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-c667c0ef-156b-42de-bb53-b40650f715f1 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:32.750983 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-c667c0ef-156b-42de-bb53-b40650f715f1 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1217 microversion: 2.1 time: 0.088458 Oct 24 08:49:32.751554 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 141/287] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:32 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:32.861801 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-cbbfd8e5-097a-4358-9532-ab15fd868e6a tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:32.874027 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-cbbfd8e5-097a-4358-9532-ab15fd868e6a tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1358 microversion: 2.1 time: 0.156823 Oct 24 08:49:32.874782 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 147/288] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:32 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:33.403647 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-a0f62a16-859e-4f79-b724-2ce5a1b812a7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:33.404196 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-a0f62a16-859e-4f79-b724-2ce5a1b812a7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:33.411064 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a0f62a16-859e-4f79-b724-2ce5a1b812a7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:33.411630 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a0f62a16-859e-4f79-b724-2ce5a1b812a7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:33.412077 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a0f62a16-859e-4f79-b724-2ce5a1b812a7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:33.412847 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a0f62a16-859e-4f79-b724-2ce5a1b812a7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:33.413363 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a0f62a16-859e-4f79-b724-2ce5a1b812a7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:33.413822 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a0f62a16-859e-4f79-b724-2ce5a1b812a7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:33.562834 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a0f62a16-859e-4f79-b724-2ce5a1b812a7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:33.571242 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-a0f62a16-859e-4f79-b724-2ce5a1b812a7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.171554 Oct 24 08:49:33.571988 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 142/289] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:33 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:33.777811 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-514ed5c6-b2e0-43a2-aeab-8ec80df4f01e tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:33.778662 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-514ed5c6-b2e0-43a2-aeab-8ec80df4f01e tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:33.788659 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-514ed5c6-b2e0-43a2-aeab-8ec80df4f01e tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:33.789137 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-514ed5c6-b2e0-43a2-aeab-8ec80df4f01e tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:33.789562 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-514ed5c6-b2e0-43a2-aeab-8ec80df4f01e tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:33.790245 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-514ed5c6-b2e0-43a2-aeab-8ec80df4f01e tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:33.790691 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-514ed5c6-b2e0-43a2-aeab-8ec80df4f01e tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:33.791519 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-514ed5c6-b2e0-43a2-aeab-8ec80df4f01e tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:33.861340 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-514ed5c6-b2e0-43a2-aeab-8ec80df4f01e tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:33.869615 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-514ed5c6-b2e0-43a2-aeab-8ec80df4f01e tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1217 microversion: 2.1 time: 0.098569 Oct 24 08:49:33.870175 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 148/290] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:33 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:33.899351 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-dca29b45-94e9-4894-a28f-13d117dbc734 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:33.899966 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-dca29b45-94e9-4894-a28f-13d117dbc734 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:33.906343 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-dca29b45-94e9-4894-a28f-13d117dbc734 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:33.906860 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-dca29b45-94e9-4894-a28f-13d117dbc734 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:33.907294 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-dca29b45-94e9-4894-a28f-13d117dbc734 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:33.907977 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-dca29b45-94e9-4894-a28f-13d117dbc734 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:33.908425 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-dca29b45-94e9-4894-a28f-13d117dbc734 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:33.908879 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-dca29b45-94e9-4894-a28f-13d117dbc734 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:34.044855 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-dca29b45-94e9-4894-a28f-13d117dbc734 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:34.053047 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-dca29b45-94e9-4894-a28f-13d117dbc734 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1358 microversion: 2.1 time: 0.157615 Oct 24 08:49:34.053620 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 143/291] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:33 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:34.593514 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-20cd8ebd-14c2-48a1-887a-ee99a86ad4bd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:34.594197 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-20cd8ebd-14c2-48a1-887a-ee99a86ad4bd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:34.600137 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-20cd8ebd-14c2-48a1-887a-ee99a86ad4bd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:34.600620 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-20cd8ebd-14c2-48a1-887a-ee99a86ad4bd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:34.601052 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-20cd8ebd-14c2-48a1-887a-ee99a86ad4bd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:34.601854 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-20cd8ebd-14c2-48a1-887a-ee99a86ad4bd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:34.602422 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-20cd8ebd-14c2-48a1-887a-ee99a86ad4bd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:34.602965 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-20cd8ebd-14c2-48a1-887a-ee99a86ad4bd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:34.735767 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-20cd8ebd-14c2-48a1-887a-ee99a86ad4bd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:34.743654 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-20cd8ebd-14c2-48a1-887a-ee99a86ad4bd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.153979 Oct 24 08:49:34.744225 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 149/292] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:34 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:34.894909 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-89d9f4e0-5ea3-408d-b3b2-a2b6334be4ef tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:34.894909 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-89d9f4e0-5ea3-408d-b3b2-a2b6334be4ef tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:34.898745 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-89d9f4e0-5ea3-408d-b3b2-a2b6334be4ef tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:34.899325 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-89d9f4e0-5ea3-408d-b3b2-a2b6334be4ef tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:34.899769 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-89d9f4e0-5ea3-408d-b3b2-a2b6334be4ef tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:34.900462 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-89d9f4e0-5ea3-408d-b3b2-a2b6334be4ef tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:34.900910 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-89d9f4e0-5ea3-408d-b3b2-a2b6334be4ef tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:34.901511 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-89d9f4e0-5ea3-408d-b3b2-a2b6334be4ef tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:34.968446 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-89d9f4e0-5ea3-408d-b3b2-a2b6334be4ef tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:34.976467 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-89d9f4e0-5ea3-408d-b3b2-a2b6334be4ef tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1217 microversion: 2.1 time: 0.088570 Oct 24 08:49:34.977035 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 144/293] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:34 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:35.078346 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-0875f182-ea8e-4bf4-9436-81f294469985 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:35.079302 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-0875f182-ea8e-4bf4-9436-81f294469985 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:35.088672 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0875f182-ea8e-4bf4-9436-81f294469985 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:35.089340 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0875f182-ea8e-4bf4-9436-81f294469985 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:35.090229 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0875f182-ea8e-4bf4-9436-81f294469985 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:35.091308 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0875f182-ea8e-4bf4-9436-81f294469985 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:35.092113 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0875f182-ea8e-4bf4-9436-81f294469985 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:35.092763 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0875f182-ea8e-4bf4-9436-81f294469985 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:35.233972 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-0875f182-ea8e-4bf4-9436-81f294469985 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:35.245531 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-0875f182-ea8e-4bf4-9436-81f294469985 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1358 microversion: 2.1 time: 0.172590 Oct 24 08:49:35.246230 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 150/294] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:35 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:35.766511 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-559cb833-4ce4-43c6-a7dc-f5ed66357e08 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:35.767142 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-559cb833-4ce4-43c6-a7dc-f5ed66357e08 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:35.777185 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-559cb833-4ce4-43c6-a7dc-f5ed66357e08 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:35.777978 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-559cb833-4ce4-43c6-a7dc-f5ed66357e08 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:35.778730 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-559cb833-4ce4-43c6-a7dc-f5ed66357e08 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:35.779880 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-559cb833-4ce4-43c6-a7dc-f5ed66357e08 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:35.780644 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-559cb833-4ce4-43c6-a7dc-f5ed66357e08 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:35.781376 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-559cb833-4ce4-43c6-a7dc-f5ed66357e08 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:35.935634 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-559cb833-4ce4-43c6-a7dc-f5ed66357e08 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:35.943334 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-559cb833-4ce4-43c6-a7dc-f5ed66357e08 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.180779 Oct 24 08:49:35.943902 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 145/295] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:35 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:36.000873 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-3c481689-1a6d-4dce-8d7a-8e6a6e15aa2d tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:36.001756 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-3c481689-1a6d-4dce-8d7a-8e6a6e15aa2d tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:36.009963 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3c481689-1a6d-4dce-8d7a-8e6a6e15aa2d tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:36.010350 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3c481689-1a6d-4dce-8d7a-8e6a6e15aa2d tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:36.010997 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3c481689-1a6d-4dce-8d7a-8e6a6e15aa2d tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:36.011725 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3c481689-1a6d-4dce-8d7a-8e6a6e15aa2d tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:36.012282 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3c481689-1a6d-4dce-8d7a-8e6a6e15aa2d tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:36.012619 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3c481689-1a6d-4dce-8d7a-8e6a6e15aa2d tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:36.016891 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell1:SELECT=100 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:49:36.075893 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-3c481689-1a6d-4dce-8d7a-8e6a6e15aa2d tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:36.085643 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-3c481689-1a6d-4dce-8d7a-8e6a6e15aa2d tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1217 microversion: 2.1 time: 0.090291 Oct 24 08:49:36.086672 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 151/296] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:35 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:36.272689 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-367826b8-3846-4bdb-9d9b-40ca04f6b3b0 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:36.273265 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-367826b8-3846-4bdb-9d9b-40ca04f6b3b0 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:36.279700 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-367826b8-3846-4bdb-9d9b-40ca04f6b3b0 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:36.280143 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-367826b8-3846-4bdb-9d9b-40ca04f6b3b0 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:36.280605 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-367826b8-3846-4bdb-9d9b-40ca04f6b3b0 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:36.281297 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-367826b8-3846-4bdb-9d9b-40ca04f6b3b0 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:36.281787 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-367826b8-3846-4bdb-9d9b-40ca04f6b3b0 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:36.282215 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-367826b8-3846-4bdb-9d9b-40ca04f6b3b0 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:36.425499 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-367826b8-3846-4bdb-9d9b-40ca04f6b3b0 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:36.433635 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-367826b8-3846-4bdb-9d9b-40ca04f6b3b0 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1358 microversion: 2.1 time: 0.165124 Oct 24 08:49:36.434207 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 146/297] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:36 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:36.971654 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-1ac7a34a-112a-42e5-832b-59669a975c4b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:36.973262 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-1ac7a34a-112a-42e5-832b-59669a975c4b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:36.989294 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1ac7a34a-112a-42e5-832b-59669a975c4b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:36.990101 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1ac7a34a-112a-42e5-832b-59669a975c4b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:36.990956 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1ac7a34a-112a-42e5-832b-59669a975c4b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:36.992177 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1ac7a34a-112a-42e5-832b-59669a975c4b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:36.992629 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1ac7a34a-112a-42e5-832b-59669a975c4b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:36.993049 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1ac7a34a-112a-42e5-832b-59669a975c4b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:37.111065 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-01dd2bf2-82ed-47de-b3f2-ed4961973347 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:37.111569 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-01dd2bf2-82ed-47de-b3f2-ed4961973347 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:37.117596 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-01dd2bf2-82ed-47de-b3f2-ed4961973347 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:37.118075 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-01dd2bf2-82ed-47de-b3f2-ed4961973347 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:37.118538 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-01dd2bf2-82ed-47de-b3f2-ed4961973347 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:37.119247 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-01dd2bf2-82ed-47de-b3f2-ed4961973347 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:37.119691 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-01dd2bf2-82ed-47de-b3f2-ed4961973347 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:37.120106 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-01dd2bf2-82ed-47de-b3f2-ed4961973347 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:37.137331 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-1ac7a34a-112a-42e5-832b-59669a975c4b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:37.145103 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-1ac7a34a-112a-42e5-832b-59669a975c4b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.179997 Oct 24 08:49:37.145685 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 152/298] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:36 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:37.181251 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-01dd2bf2-82ed-47de-b3f2-ed4961973347 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:37.189555 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-01dd2bf2-82ed-47de-b3f2-ed4961973347 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1217 microversion: 2.1 time: 0.082413 Oct 24 08:49:37.190052 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 147/299] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:37 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:37.460338 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-92a0a584-0883-4c58-838b-6e844972fa8f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:37.461353 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-92a0a584-0883-4c58-838b-6e844972fa8f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:37.471339 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-92a0a584-0883-4c58-838b-6e844972fa8f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:37.472151 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-92a0a584-0883-4c58-838b-6e844972fa8f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:37.472873 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-92a0a584-0883-4c58-838b-6e844972fa8f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:37.473995 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-92a0a584-0883-4c58-838b-6e844972fa8f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:37.474780 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-92a0a584-0883-4c58-838b-6e844972fa8f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:37.475491 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-92a0a584-0883-4c58-838b-6e844972fa8f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:37.612144 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-92a0a584-0883-4c58-838b-6e844972fa8f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:37.620377 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-92a0a584-0883-4c58-838b-6e844972fa8f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1358 microversion: 2.1 time: 0.166605 Oct 24 08:49:37.620920 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 153/300] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:37 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:38.172092 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-7acd5a66-dd0c-4e7f-a792-d176f237a646 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:38.173069 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-7acd5a66-dd0c-4e7f-a792-d176f237a646 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:38.183450 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7acd5a66-dd0c-4e7f-a792-d176f237a646 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:38.184300 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7acd5a66-dd0c-4e7f-a792-d176f237a646 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:38.184977 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7acd5a66-dd0c-4e7f-a792-d176f237a646 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:38.186100 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7acd5a66-dd0c-4e7f-a792-d176f237a646 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:38.186915 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7acd5a66-dd0c-4e7f-a792-d176f237a646 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:38.187609 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7acd5a66-dd0c-4e7f-a792-d176f237a646 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:38.212107 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-c132ea8a-f5d2-4934-bb03-42c8d7de902f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:38.212813 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-c132ea8a-f5d2-4934-bb03-42c8d7de902f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:38.219579 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c132ea8a-f5d2-4934-bb03-42c8d7de902f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:38.220067 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c132ea8a-f5d2-4934-bb03-42c8d7de902f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:38.220560 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c132ea8a-f5d2-4934-bb03-42c8d7de902f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:38.221259 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c132ea8a-f5d2-4934-bb03-42c8d7de902f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:38.221704 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c132ea8a-f5d2-4934-bb03-42c8d7de902f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:38.222139 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c132ea8a-f5d2-4934-bb03-42c8d7de902f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:38.301180 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-c132ea8a-f5d2-4934-bb03-42c8d7de902f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:38.310043 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-c132ea8a-f5d2-4934-bb03-42c8d7de902f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1217 microversion: 2.1 time: 0.101222 Oct 24 08:49:38.310618 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 154/301] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:38 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:38.341563 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-7acd5a66-dd0c-4e7f-a792-d176f237a646 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:38.349398 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-7acd5a66-dd0c-4e7f-a792-d176f237a646 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.184186 Oct 24 08:49:38.349893 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 148/302] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:38 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:38.643185 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-7d2428fc-7e8c-4734-9fc0-da9e77bd70a4 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:38.643797 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-7d2428fc-7e8c-4734-9fc0-da9e77bd70a4 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:38.650181 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7d2428fc-7e8c-4734-9fc0-da9e77bd70a4 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:38.650694 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7d2428fc-7e8c-4734-9fc0-da9e77bd70a4 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:38.651183 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7d2428fc-7e8c-4734-9fc0-da9e77bd70a4 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:38.651869 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7d2428fc-7e8c-4734-9fc0-da9e77bd70a4 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:38.652287 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7d2428fc-7e8c-4734-9fc0-da9e77bd70a4 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:38.652766 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7d2428fc-7e8c-4734-9fc0-da9e77bd70a4 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:38.783033 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-7d2428fc-7e8c-4734-9fc0-da9e77bd70a4 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:38.790667 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-7d2428fc-7e8c-4734-9fc0-da9e77bd70a4 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1358 microversion: 2.1 time: 0.151498 Oct 24 08:49:38.791614 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 155/303] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:38 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:39.333013 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-6eb1eccc-02c8-4915-9ec7-5ab7196c7584 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:39.333631 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-6eb1eccc-02c8-4915-9ec7-5ab7196c7584 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:39.340160 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6eb1eccc-02c8-4915-9ec7-5ab7196c7584 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:39.340642 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6eb1eccc-02c8-4915-9ec7-5ab7196c7584 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:39.341072 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6eb1eccc-02c8-4915-9ec7-5ab7196c7584 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:39.341751 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6eb1eccc-02c8-4915-9ec7-5ab7196c7584 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:39.342225 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6eb1eccc-02c8-4915-9ec7-5ab7196c7584 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:39.342641 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6eb1eccc-02c8-4915-9ec7-5ab7196c7584 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:39.372100 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-9b9532d5-835b-4550-a609-1d8368be87c1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:39.372837 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-9b9532d5-835b-4550-a609-1d8368be87c1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:39.379853 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9b9532d5-835b-4550-a609-1d8368be87c1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:39.380432 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9b9532d5-835b-4550-a609-1d8368be87c1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:39.380940 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9b9532d5-835b-4550-a609-1d8368be87c1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:39.381704 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9b9532d5-835b-4550-a609-1d8368be87c1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:39.382225 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9b9532d5-835b-4550-a609-1d8368be87c1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:39.382753 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9b9532d5-835b-4550-a609-1d8368be87c1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:39.404680 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-6eb1eccc-02c8-4915-9ec7-5ab7196c7584 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:39.412652 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-6eb1eccc-02c8-4915-9ec7-5ab7196c7584 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1217 microversion: 2.1 time: 0.083570 Oct 24 08:49:39.413232 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 149/304] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:39 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:39.516156 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-9b9532d5-835b-4550-a609-1d8368be87c1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:39.524363 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-9b9532d5-835b-4550-a609-1d8368be87c1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.156202 Oct 24 08:49:39.525023 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 156/305] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:39 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:49:39.817756 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-73d10bff-e237-41d4-8fb6-83bc4a8f885c tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:39.818642 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-73d10bff-e237-41d4-8fb6-83bc4a8f885c tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:39.828662 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-73d10bff-e237-41d4-8fb6-83bc4a8f885c tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:39.829458 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-73d10bff-e237-41d4-8fb6-83bc4a8f885c tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:39.830173 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-73d10bff-e237-41d4-8fb6-83bc4a8f885c tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:39.831339 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-73d10bff-e237-41d4-8fb6-83bc4a8f885c tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:39.832088 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-73d10bff-e237-41d4-8fb6-83bc4a8f885c tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:39.832790 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-73d10bff-e237-41d4-8fb6-83bc4a8f885c tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:39.971523 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-73d10bff-e237-41d4-8fb6-83bc4a8f885c tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:39.982775 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-73d10bff-e237-41d4-8fb6-83bc4a8f885c tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1358 microversion: 2.1 time: 0.171522 Oct 24 08:49:39.983558 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 150/306] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:39 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:40.440017 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-ecf1b2c4-3c00-488a-bb90-4d7524bada7c tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:40.440989 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-ecf1b2c4-3c00-488a-bb90-4d7524bada7c tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:40.449373 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ecf1b2c4-3c00-488a-bb90-4d7524bada7c tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:40.449853 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ecf1b2c4-3c00-488a-bb90-4d7524bada7c tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:40.450282 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ecf1b2c4-3c00-488a-bb90-4d7524bada7c tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:40.450992 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ecf1b2c4-3c00-488a-bb90-4d7524bada7c tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:40.451438 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ecf1b2c4-3c00-488a-bb90-4d7524bada7c tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:40.451850 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ecf1b2c4-3c00-488a-bb90-4d7524bada7c tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:40.511993 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-ecf1b2c4-3c00-488a-bb90-4d7524bada7c tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:40.519846 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-ecf1b2c4-3c00-488a-bb90-4d7524bada7c tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1217 microversion: 2.1 time: 0.086308 Oct 24 08:49:40.520398 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 157/307] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:40 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:40.548177 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-01212c26-2469-43d5-bc50-ffe544b844c8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:40.549396 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-01212c26-2469-43d5-bc50-ffe544b844c8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:40.555888 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-01212c26-2469-43d5-bc50-ffe544b844c8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:40.556373 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-01212c26-2469-43d5-bc50-ffe544b844c8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:40.556821 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-01212c26-2469-43d5-bc50-ffe544b844c8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:40.557495 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-01212c26-2469-43d5-bc50-ffe544b844c8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:40.557946 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-01212c26-2469-43d5-bc50-ffe544b844c8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:40.558344 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-01212c26-2469-43d5-bc50-ffe544b844c8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:40.692326 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-01212c26-2469-43d5-bc50-ffe544b844c8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:40.694525 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell1:SELECT=100 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:49:40.701391 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-01212c26-2469-43d5-bc50-ffe544b844c8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.157215 Oct 24 08:49:40.705193 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 151/308] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:40 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:41.009071 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-06f7394e-5acf-4149-aec0-473b1759766f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:41.009961 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-06f7394e-5acf-4149-aec0-473b1759766f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:41.016161 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-06f7394e-5acf-4149-aec0-473b1759766f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:41.016780 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-06f7394e-5acf-4149-aec0-473b1759766f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:41.017258 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-06f7394e-5acf-4149-aec0-473b1759766f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:41.018052 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-06f7394e-5acf-4149-aec0-473b1759766f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:41.018560 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-06f7394e-5acf-4149-aec0-473b1759766f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:41.019042 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-06f7394e-5acf-4149-aec0-473b1759766f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:41.156373 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-06f7394e-5acf-4149-aec0-473b1759766f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:41.164642 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-06f7394e-5acf-4149-aec0-473b1759766f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1358 microversion: 2.1 time: 0.159616 Oct 24 08:49:41.165245 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 158/309] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:41 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:41.544213 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-80542ef3-58f4-496a-b48a-c6665d1619f3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:41.544829 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-80542ef3-58f4-496a-b48a-c6665d1619f3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:41.546693 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:49:41.552099 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-80542ef3-58f4-496a-b48a-c6665d1619f3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:41.552694 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-80542ef3-58f4-496a-b48a-c6665d1619f3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:41.553012 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-80542ef3-58f4-496a-b48a-c6665d1619f3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:41.553705 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-80542ef3-58f4-496a-b48a-c6665d1619f3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:41.554158 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-80542ef3-58f4-496a-b48a-c6665d1619f3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:41.554677 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-80542ef3-58f4-496a-b48a-c6665d1619f3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:41.616393 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-80542ef3-58f4-496a-b48a-c6665d1619f3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:41.624682 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-80542ef3-58f4-496a-b48a-c6665d1619f3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1217 microversion: 2.1 time: 0.085167 Oct 24 08:49:41.625335 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 152/310] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:41 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:41.727825 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-dfc97c84-d4a5-43be-b91c-4fa8fa2e73f7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:41.728452 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-dfc97c84-d4a5-43be-b91c-4fa8fa2e73f7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:41.735312 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-dfc97c84-d4a5-43be-b91c-4fa8fa2e73f7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:41.735801 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-dfc97c84-d4a5-43be-b91c-4fa8fa2e73f7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:41.736234 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-dfc97c84-d4a5-43be-b91c-4fa8fa2e73f7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:41.736929 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-dfc97c84-d4a5-43be-b91c-4fa8fa2e73f7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:41.737417 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-dfc97c84-d4a5-43be-b91c-4fa8fa2e73f7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:41.737783 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-dfc97c84-d4a5-43be-b91c-4fa8fa2e73f7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:41.871005 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-dfc97c84-d4a5-43be-b91c-4fa8fa2e73f7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:41.878980 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-dfc97c84-d4a5-43be-b91c-4fa8fa2e73f7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.157535 Oct 24 08:49:41.879542 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 159/311] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:41 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:42.190460 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-9e90772c-c389-4df5-974e-e9b48efb550f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:42.192302 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-9e90772c-c389-4df5-974e-e9b48efb550f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:42.201223 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9e90772c-c389-4df5-974e-e9b48efb550f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:42.202108 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9e90772c-c389-4df5-974e-e9b48efb550f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:42.202765 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9e90772c-c389-4df5-974e-e9b48efb550f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:42.203860 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9e90772c-c389-4df5-974e-e9b48efb550f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:42.204879 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9e90772c-c389-4df5-974e-e9b48efb550f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:42.205759 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9e90772c-c389-4df5-974e-e9b48efb550f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:42.543170 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-9e90772c-c389-4df5-974e-e9b48efb550f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:42.555738 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-9e90772c-c389-4df5-974e-e9b48efb550f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1358 microversion: 2.1 time: 0.372129 Oct 24 08:49:42.556674 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 153/312] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:42 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1358 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:42.655500 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-29a487a9-8bdc-4e30-ac20-0b22dec4c3a7 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:42.656124 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-29a487a9-8bdc-4e30-ac20-0b22dec4c3a7 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:42.662176 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-29a487a9-8bdc-4e30-ac20-0b22dec4c3a7 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:42.662648 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-29a487a9-8bdc-4e30-ac20-0b22dec4c3a7 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:42.663121 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-29a487a9-8bdc-4e30-ac20-0b22dec4c3a7 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:42.663871 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-29a487a9-8bdc-4e30-ac20-0b22dec4c3a7 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:42.664325 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-29a487a9-8bdc-4e30-ac20-0b22dec4c3a7 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:42.664750 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-29a487a9-8bdc-4e30-ac20-0b22dec4c3a7 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:42.735874 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-29a487a9-8bdc-4e30-ac20-0b22dec4c3a7 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:42.743697 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-29a487a9-8bdc-4e30-ac20-0b22dec4c3a7 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1265 microversion: 2.1 time: 0.092124 Oct 24 08:49:42.744257 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 160/313] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:42 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1265 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:42.901931 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-a09f1f58-adc3-4c59-ada8-6153b90e2431 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:42.902632 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-a09f1f58-adc3-4c59-ada8-6153b90e2431 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:42.908994 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a09f1f58-adc3-4c59-ada8-6153b90e2431 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:42.909548 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a09f1f58-adc3-4c59-ada8-6153b90e2431 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:42.910157 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a09f1f58-adc3-4c59-ada8-6153b90e2431 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:42.910953 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a09f1f58-adc3-4c59-ada8-6153b90e2431 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:42.911403 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a09f1f58-adc3-4c59-ada8-6153b90e2431 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:42.912206 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a09f1f58-adc3-4c59-ada8-6153b90e2431 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:43.114910 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a09f1f58-adc3-4c59-ada8-6153b90e2431 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:43.122685 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-a09f1f58-adc3-4c59-ada8-6153b90e2431 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.224724 Oct 24 08:49:43.123672 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 154/314] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:42 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:43.169651 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-6556bcfa-18e5-4446-83c7-a1aba774f67c req-d899c62b-aa97-4bdb-a07c-676a910ab725 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89a67761-1e03-4ede-8f59-f719d6ea20d1", "tag": "5693bb11-79fc-4a3c-bc79-8cc96cab3b00"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:49:43.180617 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-6556bcfa-18e5-4446-83c7-a1aba774f67c req-d899c62b-aa97-4bdb-a07c-676a910ab725 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:43.181093 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-6556bcfa-18e5-4446-83c7-a1aba774f67c req-d899c62b-aa97-4bdb-a07c-676a910ab725 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:43.181601 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-6556bcfa-18e5-4446-83c7-a1aba774f67c req-d899c62b-aa97-4bdb-a07c-676a910ab725 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:43.194118 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-6556bcfa-18e5-4446-83c7-a1aba774f67c req-d899c62b-aa97-4bdb-a07c-676a910ab725 service nova] Creating event network-changed:5693bb11-79fc-4a3c-bc79-8cc96cab3b00 for instance 89a67761-1e03-4ede-8f59-f719d6ea20d1 on hv-cinder-maste Oct 24 08:49:43.199884 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-6556bcfa-18e5-4446-83c7-a1aba774f67c req-d899c62b-aa97-4bdb-a07c-676a910ab725 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034427 Oct 24 08:49:43.200469 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 161/315] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:49:43.579274 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-21cd5ec0-c5d7-44c6-9938-b72a675acb3d tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:43.579998 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-21cd5ec0-c5d7-44c6-9938-b72a675acb3d tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:43.586506 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-21cd5ec0-c5d7-44c6-9938-b72a675acb3d tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:43.587009 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-21cd5ec0-c5d7-44c6-9938-b72a675acb3d tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:43.587468 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-21cd5ec0-c5d7-44c6-9938-b72a675acb3d tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:43.588268 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-21cd5ec0-c5d7-44c6-9938-b72a675acb3d tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:43.588714 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-21cd5ec0-c5d7-44c6-9938-b72a675acb3d tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:43.589127 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-21cd5ec0-c5d7-44c6-9938-b72a675acb3d tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:43.727755 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-21cd5ec0-c5d7-44c6-9938-b72a675acb3d tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:43.739018 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-21cd5ec0-c5d7-44c6-9938-b72a675acb3d tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1358 microversion: 2.1 time: 0.163730 Oct 24 08:49:43.739770 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 155/316] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:43 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:43.768676 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-be9b8006-be3f-4bb2-9889-777d73d35019 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:43.769376 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-be9b8006-be3f-4bb2-9889-777d73d35019 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:43.775660 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-be9b8006-be3f-4bb2-9889-777d73d35019 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:43.776216 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-be9b8006-be3f-4bb2-9889-777d73d35019 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:43.776612 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-be9b8006-be3f-4bb2-9889-777d73d35019 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:43.777356 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-be9b8006-be3f-4bb2-9889-777d73d35019 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:43.777809 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-be9b8006-be3f-4bb2-9889-777d73d35019 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:43.778234 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-be9b8006-be3f-4bb2-9889-777d73d35019 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:43.840716 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-be9b8006-be3f-4bb2-9889-777d73d35019 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:43.848640 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-be9b8006-be3f-4bb2-9889-777d73d35019 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1265 microversion: 2.1 time: 0.084652 Oct 24 08:49:43.849204 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 162/317] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:43 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:44.151835 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-92f7d638-c3e0-459a-9d3b-6b7fa72d026d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:44.152827 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-92f7d638-c3e0-459a-9d3b-6b7fa72d026d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:44.163084 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-92f7d638-c3e0-459a-9d3b-6b7fa72d026d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:44.164013 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-92f7d638-c3e0-459a-9d3b-6b7fa72d026d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:44.164454 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-92f7d638-c3e0-459a-9d3b-6b7fa72d026d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:44.165151 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-92f7d638-c3e0-459a-9d3b-6b7fa72d026d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:44.165602 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-92f7d638-c3e0-459a-9d3b-6b7fa72d026d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:44.166393 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-92f7d638-c3e0-459a-9d3b-6b7fa72d026d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:44.397121 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-92f7d638-c3e0-459a-9d3b-6b7fa72d026d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:44.404771 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-92f7d638-c3e0-459a-9d3b-6b7fa72d026d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.261008 Oct 24 08:49:44.405498 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 156/318] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:44 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:44.765417 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-b0810640-e567-45ff-9faa-87b6316d02bc tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:44.766129 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-b0810640-e567-45ff-9faa-87b6316d02bc tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:44.787902 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b0810640-e567-45ff-9faa-87b6316d02bc tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:44.790034 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b0810640-e567-45ff-9faa-87b6316d02bc tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:44.790681 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b0810640-e567-45ff-9faa-87b6316d02bc tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:44.791943 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b0810640-e567-45ff-9faa-87b6316d02bc tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:44.792586 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b0810640-e567-45ff-9faa-87b6316d02bc tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:44.793372 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b0810640-e567-45ff-9faa-87b6316d02bc tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:44.871806 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-8613c898-4349-4db1-987b-0d7492cfd4a8 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:44.872979 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-8613c898-4349-4db1-987b-0d7492cfd4a8 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:44.879143 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8613c898-4349-4db1-987b-0d7492cfd4a8 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:44.879628 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8613c898-4349-4db1-987b-0d7492cfd4a8 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:44.880048 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8613c898-4349-4db1-987b-0d7492cfd4a8 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:44.880895 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8613c898-4349-4db1-987b-0d7492cfd4a8 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:44.881335 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8613c898-4349-4db1-987b-0d7492cfd4a8 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:44.881918 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8613c898-4349-4db1-987b-0d7492cfd4a8 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:44.998632 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-8613c898-4349-4db1-987b-0d7492cfd4a8 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:45.006695 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-8613c898-4349-4db1-987b-0d7492cfd4a8 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1283 microversion: 2.1 time: 0.138968 Oct 24 08:49:45.007298 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 157/319] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:44 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1283 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:49:45.086183 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-b0810640-e567-45ff-9faa-87b6316d02bc tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:45.094620 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-b0810640-e567-45ff-9faa-87b6316d02bc tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1358 microversion: 2.1 time: 0.335513 Oct 24 08:49:45.095261 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 163/320] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:44 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1358 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:45.432291 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-401d5f82-ef7d-465c-b862-0aaae739e1b1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:45.433097 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-401d5f82-ef7d-465c-b862-0aaae739e1b1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:45.443256 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-401d5f82-ef7d-465c-b862-0aaae739e1b1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:45.445626 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-401d5f82-ef7d-465c-b862-0aaae739e1b1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:45.446092 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-401d5f82-ef7d-465c-b862-0aaae739e1b1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:45.446987 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-401d5f82-ef7d-465c-b862-0aaae739e1b1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:45.447748 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-401d5f82-ef7d-465c-b862-0aaae739e1b1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:45.448296 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-401d5f82-ef7d-465c-b862-0aaae739e1b1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:45.602450 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-401d5f82-ef7d-465c-b862-0aaae739e1b1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:45.611103 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-401d5f82-ef7d-465c-b862-0aaae739e1b1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1522 microversion: 2.1 time: 0.187169 Oct 24 08:49:45.611692 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 158/321] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:45 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:46.029587 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-37fc40d0-99e6-42ff-ad66-085b155ce749 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:46.030810 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-37fc40d0-99e6-42ff-ad66-085b155ce749 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:46.037186 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-37fc40d0-99e6-42ff-ad66-085b155ce749 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:46.037664 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-37fc40d0-99e6-42ff-ad66-085b155ce749 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:46.038099 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-37fc40d0-99e6-42ff-ad66-085b155ce749 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:46.038804 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-37fc40d0-99e6-42ff-ad66-085b155ce749 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:46.039251 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-37fc40d0-99e6-42ff-ad66-085b155ce749 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:46.039666 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-37fc40d0-99e6-42ff-ad66-085b155ce749 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:46.117921 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-dc2bffff-ff94-4ac8-9b37-51339140f320 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:46.118538 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-dc2bffff-ff94-4ac8-9b37-51339140f320 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:46.124649 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-dc2bffff-ff94-4ac8-9b37-51339140f320 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:46.125420 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-dc2bffff-ff94-4ac8-9b37-51339140f320 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:46.126226 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-dc2bffff-ff94-4ac8-9b37-51339140f320 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:46.126741 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-dc2bffff-ff94-4ac8-9b37-51339140f320 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:46.127230 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-dc2bffff-ff94-4ac8-9b37-51339140f320 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:46.127648 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-dc2bffff-ff94-4ac8-9b37-51339140f320 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:46.273874 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-37fc40d0-99e6-42ff-ad66-085b155ce749 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:46.286543 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-37fc40d0-99e6-42ff-ad66-085b155ce749 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1313 microversion: 2.1 time: 0.260760 Oct 24 08:49:46.287914 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 164/322] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:46 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1313 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:46.340963 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-dc2bffff-ff94-4ac8-9b37-51339140f320 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:46.348640 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-dc2bffff-ff94-4ac8-9b37-51339140f320 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1358 microversion: 2.1 time: 0.235144 Oct 24 08:49:46.349206 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 159/323] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:46 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1358 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:46.633754 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-64a08a52-324b-41ae-bb36-48670d14364d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:46.634364 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-64a08a52-324b-41ae-bb36-48670d14364d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:46.640393 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-64a08a52-324b-41ae-bb36-48670d14364d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:46.640882 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-64a08a52-324b-41ae-bb36-48670d14364d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:46.641312 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-64a08a52-324b-41ae-bb36-48670d14364d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:46.641994 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-64a08a52-324b-41ae-bb36-48670d14364d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:46.642443 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-64a08a52-324b-41ae-bb36-48670d14364d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:46.642891 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-64a08a52-324b-41ae-bb36-48670d14364d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:46.778465 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-64a08a52-324b-41ae-bb36-48670d14364d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:46.787389 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-64a08a52-324b-41ae-bb36-48670d14364d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1502 microversion: 2.1 time: 0.157456 Oct 24 08:49:46.788153 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 165/324] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:46 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:46.809705 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-58bcc188-b239-4f70-84e5-94b2480a6462 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:46.810341 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-58bcc188-b239-4f70-84e5-94b2480a6462 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f2772d7f-d505-44ab-a062-58bd88bd49d3] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:46.816527 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-58bcc188-b239-4f70-84e5-94b2480a6462 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:46.817010 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-58bcc188-b239-4f70-84e5-94b2480a6462 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:46.817435 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-58bcc188-b239-4f70-84e5-94b2480a6462 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:46.818150 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-58bcc188-b239-4f70-84e5-94b2480a6462 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:46.818591 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-58bcc188-b239-4f70-84e5-94b2480a6462 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:46.819116 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-58bcc188-b239-4f70-84e5-94b2480a6462 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:46.984822 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-58bcc188-b239-4f70-84e5-94b2480a6462 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:46.996253 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-58bcc188-b239-4f70-84e5-94b2480a6462 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3" status: 200 len: 1516 microversion: 2.1 time: 0.190455 Oct 24 08:49:46.996821 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 160/325] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:46 2022] GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3 => generated 1516 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:47.313255 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-9059a7af-8d07-442c-8af9-9e19edc085c2 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:47.313838 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-9059a7af-8d07-442c-8af9-9e19edc085c2 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:47.321727 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9059a7af-8d07-442c-8af9-9e19edc085c2 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:47.322217 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9059a7af-8d07-442c-8af9-9e19edc085c2 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:47.322654 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9059a7af-8d07-442c-8af9-9e19edc085c2 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:47.323390 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9059a7af-8d07-442c-8af9-9e19edc085c2 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:47.323848 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9059a7af-8d07-442c-8af9-9e19edc085c2 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:47.324274 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9059a7af-8d07-442c-8af9-9e19edc085c2 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:47.331467 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-56ad38ac-1212-4367-bf7c-fceaff899ba4 req-77ae322a-619c-4ccc-88f7-2ec59721082c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0481f739-3230-4857-b001-c94f5ac479e8", "tag": "ee0013da-988a-43dc-b8d5-a9b2a49275bd"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:49:47.355267 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-56ad38ac-1212-4367-bf7c-fceaff899ba4 req-77ae322a-619c-4ccc-88f7-2ec59721082c service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:47.356760 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-56ad38ac-1212-4367-bf7c-fceaff899ba4 req-77ae322a-619c-4ccc-88f7-2ec59721082c service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:47.357937 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-56ad38ac-1212-4367-bf7c-fceaff899ba4 req-77ae322a-619c-4ccc-88f7-2ec59721082c service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:47.374062 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-56ad38ac-1212-4367-bf7c-fceaff899ba4 req-77ae322a-619c-4ccc-88f7-2ec59721082c service nova] Creating event network-changed:ee0013da-988a-43dc-b8d5-a9b2a49275bd for instance 0481f739-3230-4857-b001-c94f5ac479e8 on hv-cinder-maste Oct 24 08:49:47.381457 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-56ad38ac-1212-4367-bf7c-fceaff899ba4 req-77ae322a-619c-4ccc-88f7-2ec59721082c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053899 Oct 24 08:49:47.383020 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 161/326] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:49:47.391215 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-61dd2963-2495-42cd-bda1-f19b675c1533 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:47.392745 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-61dd2963-2495-42cd-bda1-f19b675c1533 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:47.405114 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-61dd2963-2495-42cd-bda1-f19b675c1533 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:47.408207 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-61dd2963-2495-42cd-bda1-f19b675c1533 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:47.408983 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-61dd2963-2495-42cd-bda1-f19b675c1533 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:47.410404 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-61dd2963-2495-42cd-bda1-f19b675c1533 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:47.412856 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-61dd2963-2495-42cd-bda1-f19b675c1533 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:47.414181 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-61dd2963-2495-42cd-bda1-f19b675c1533 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:47.713561 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-9059a7af-8d07-442c-8af9-9e19edc085c2 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:47.722618 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-9059a7af-8d07-442c-8af9-9e19edc085c2 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1313 microversion: 2.1 time: 0.415120 Oct 24 08:49:47.726488 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 166/327] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:47 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1313 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:47.740557 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-61dd2963-2495-42cd-bda1-f19b675c1533 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:47.749163 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-61dd2963-2495-42cd-bda1-f19b675c1533 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1358 microversion: 2.1 time: 0.364430 Oct 24 08:49:47.750074 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 162/328] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:47 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1358 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:48.648964 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-a6694784-23ec-4fe5-9c9a-badc1a88b3a3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:49:48.651527 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-a6694784-23ec-4fe5-9c9a-badc1a88b3a3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f2772d7f-d505-44ab-a062-58bd88bd49d3] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:48.658294 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a6694784-23ec-4fe5-9c9a-badc1a88b3a3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:48.659077 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a6694784-23ec-4fe5-9c9a-badc1a88b3a3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:48.659710 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a6694784-23ec-4fe5-9c9a-badc1a88b3a3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:48.660580 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a6694784-23ec-4fe5-9c9a-badc1a88b3a3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:48.661353 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a6694784-23ec-4fe5-9c9a-badc1a88b3a3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:48.661922 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a6694784-23ec-4fe5-9c9a-badc1a88b3a3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:48.685466 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.objects.instance [None req-a6694784-23ec-4fe5-9c9a-badc1a88b3a3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lazy-loading 'flavor' on Instance uuid f2772d7f-d505-44ab-a062-58bd88bd49d3 {{(pid=125164) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:49:48.745872 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-f4637ade-d543-4457-a2f2-7252fd663f1f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:48.746495 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-f4637ade-d543-4457-a2f2-7252fd663f1f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:48.752629 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f4637ade-d543-4457-a2f2-7252fd663f1f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:48.753278 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f4637ade-d543-4457-a2f2-7252fd663f1f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:48.753862 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f4637ade-d543-4457-a2f2-7252fd663f1f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:48.754707 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f4637ade-d543-4457-a2f2-7252fd663f1f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:48.755337 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f4637ade-d543-4457-a2f2-7252fd663f1f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:48.755906 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f4637ade-d543-4457-a2f2-7252fd663f1f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:48.759797 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:49:48.822441 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-a6694784-23ec-4fe5-9c9a-badc1a88b3a3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "POST /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3/action" status: 200 len: 32 microversion: 2.1 time: 0.177858 Oct 24 08:49:48.823186 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 167/329] 10.222.0.26 () {60 vars in 1278 bytes} [Mon Oct 24 08:49:48 2022] POST /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3/action => generated 32 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:49:48.828824 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-126555cd-9bf3-44bf-9bc6-c0658c068544 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:48.829742 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-126555cd-9bf3-44bf-9bc6-c0658c068544 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:48.832078 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:49:48.838140 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-126555cd-9bf3-44bf-9bc6-c0658c068544 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:48.839109 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-126555cd-9bf3-44bf-9bc6-c0658c068544 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:48.839795 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-126555cd-9bf3-44bf-9bc6-c0658c068544 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:48.840995 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-126555cd-9bf3-44bf-9bc6-c0658c068544 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:48.841690 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-126555cd-9bf3-44bf-9bc6-c0658c068544 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:48.842187 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-126555cd-9bf3-44bf-9bc6-c0658c068544 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:48.920091 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-f4637ade-d543-4457-a2f2-7252fd663f1f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:48.929543 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-f4637ade-d543-4457-a2f2-7252fd663f1f tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1313 microversion: 2.1 time: 0.187470 Oct 24 08:49:48.930763 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 163/330] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:48 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:49:48.935933 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-9e337ca0-b715-4318-9cde-7f5a575351c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:48.936543 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-9e337ca0-b715-4318-9cde-7f5a575351c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f2772d7f-d505-44ab-a062-58bd88bd49d3] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:48.942540 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9e337ca0-b715-4318-9cde-7f5a575351c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:48.943163 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9e337ca0-b715-4318-9cde-7f5a575351c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:48.943768 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9e337ca0-b715-4318-9cde-7f5a575351c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:48.944835 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9e337ca0-b715-4318-9cde-7f5a575351c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:48.945294 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9e337ca0-b715-4318-9cde-7f5a575351c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:48.945717 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9e337ca0-b715-4318-9cde-7f5a575351c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:48.995835 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-126555cd-9bf3-44bf-9bc6-c0658c068544 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:49.003785 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-126555cd-9bf3-44bf-9bc6-c0658c068544 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1358 microversion: 2.1 time: 0.179044 Oct 24 08:49:49.004451 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 168/331] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:48 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:49.087909 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-9e337ca0-b715-4318-9cde-7f5a575351c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:49.097071 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-9e337ca0-b715-4318-9cde-7f5a575351c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3" status: 200 len: 1522 microversion: 2.1 time: 0.165152 Oct 24 08:49:49.097769 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 164/332] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:48 2022] GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:49.958160 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-10d1cca9-9a5a-4120-8074-f4b78b0d7352 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:49.958791 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-10d1cca9-9a5a-4120-8074-f4b78b0d7352 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:49.965525 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-10d1cca9-9a5a-4120-8074-f4b78b0d7352 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:49.966009 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-10d1cca9-9a5a-4120-8074-f4b78b0d7352 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:49.966438 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-10d1cca9-9a5a-4120-8074-f4b78b0d7352 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:49.967154 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-10d1cca9-9a5a-4120-8074-f4b78b0d7352 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:49.967579 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-10d1cca9-9a5a-4120-8074-f4b78b0d7352 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:49.967996 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-10d1cca9-9a5a-4120-8074-f4b78b0d7352 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:50.026856 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-0c3ebb16-25bf-4a39-adff-97113efa4f34 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:50.027407 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-0c3ebb16-25bf-4a39-adff-97113efa4f34 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:50.033560 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0c3ebb16-25bf-4a39-adff-97113efa4f34 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:50.034057 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0c3ebb16-25bf-4a39-adff-97113efa4f34 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:50.034496 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0c3ebb16-25bf-4a39-adff-97113efa4f34 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:50.035307 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0c3ebb16-25bf-4a39-adff-97113efa4f34 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:50.035715 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0c3ebb16-25bf-4a39-adff-97113efa4f34 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:50.036140 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0c3ebb16-25bf-4a39-adff-97113efa4f34 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:50.136637 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-10d1cca9-9a5a-4120-8074-f4b78b0d7352 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:50.144690 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-10d1cca9-9a5a-4120-8074-f4b78b0d7352 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1313 microversion: 2.1 time: 0.190642 Oct 24 08:49:50.145340 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 169/333] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:49 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:50.150016 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-2394747e-fe9e-4e61-8979-069e588939e7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:50.150874 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-2394747e-fe9e-4e61-8979-069e588939e7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f2772d7f-d505-44ab-a062-58bd88bd49d3] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:50.156869 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2394747e-fe9e-4e61-8979-069e588939e7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:50.157352 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2394747e-fe9e-4e61-8979-069e588939e7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:50.157784 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2394747e-fe9e-4e61-8979-069e588939e7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:50.158484 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2394747e-fe9e-4e61-8979-069e588939e7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:50.158970 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2394747e-fe9e-4e61-8979-069e588939e7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:50.159374 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2394747e-fe9e-4e61-8979-069e588939e7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:50.196989 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-0c3ebb16-25bf-4a39-adff-97113efa4f34 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:50.204786 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-0c3ebb16-25bf-4a39-adff-97113efa4f34 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1358 microversion: 2.1 time: 0.181973 Oct 24 08:49:50.205584 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 165/334] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:50 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:49:50.298975 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-2394747e-fe9e-4e61-8979-069e588939e7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:50.308948 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-2394747e-fe9e-4e61-8979-069e588939e7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3" status: 200 len: 1522 microversion: 2.1 time: 0.162655 Oct 24 08:49:50.309548 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 170/335] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:50 2022] GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:51.170017 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-a8e65553-273d-4fff-8c33-d8ef63294d22 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:51.171212 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-a8e65553-273d-4fff-8c33-d8ef63294d22 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:51.177751 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a8e65553-273d-4fff-8c33-d8ef63294d22 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:51.178413 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a8e65553-273d-4fff-8c33-d8ef63294d22 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:51.179034 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a8e65553-273d-4fff-8c33-d8ef63294d22 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:51.179859 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a8e65553-273d-4fff-8c33-d8ef63294d22 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:51.180595 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a8e65553-273d-4fff-8c33-d8ef63294d22 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:51.181218 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a8e65553-273d-4fff-8c33-d8ef63294d22 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:51.226754 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-db736885-3c33-42ee-aac1-00b6e10ce177 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:51.231774 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-db736885-3c33-42ee-aac1-00b6e10ce177 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:51.238348 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-db736885-3c33-42ee-aac1-00b6e10ce177 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:51.242795 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-db736885-3c33-42ee-aac1-00b6e10ce177 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:51.243435 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-db736885-3c33-42ee-aac1-00b6e10ce177 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:51.244354 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-db736885-3c33-42ee-aac1-00b6e10ce177 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:51.244933 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-db736885-3c33-42ee-aac1-00b6e10ce177 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:51.252079 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-db736885-3c33-42ee-aac1-00b6e10ce177 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:51.411399 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a8e65553-273d-4fff-8c33-d8ef63294d22 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:51.419609 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-a8e65553-273d-4fff-8c33-d8ef63294d22 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1313 microversion: 2.1 time: 0.254098 Oct 24 08:49:51.420171 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 166/336] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:51 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:51.424760 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-25f73512-2598-4a67-811d-73a962e60c0f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:51.425364 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-25f73512-2598-4a67-811d-73a962e60c0f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f2772d7f-d505-44ab-a062-58bd88bd49d3] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:51.431120 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-25f73512-2598-4a67-811d-73a962e60c0f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:51.431519 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-25f73512-2598-4a67-811d-73a962e60c0f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:51.431951 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-25f73512-2598-4a67-811d-73a962e60c0f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:51.432636 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-25f73512-2598-4a67-811d-73a962e60c0f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:51.433082 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-25f73512-2598-4a67-811d-73a962e60c0f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:51.433501 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-25f73512-2598-4a67-811d-73a962e60c0f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:51.441514 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-db736885-3c33-42ee-aac1-00b6e10ce177 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:51.449400 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-db736885-3c33-42ee-aac1-00b6e10ce177 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1358 microversion: 2.1 time: 0.226466 Oct 24 08:49:51.449975 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 171/337] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:51 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1358 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:51.572898 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-25f73512-2598-4a67-811d-73a962e60c0f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:51.580708 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-25f73512-2598-4a67-811d-73a962e60c0f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3" status: 200 len: 1522 microversion: 2.1 time: 0.159575 Oct 24 08:49:51.581279 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 167/338] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:51 2022] GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:52.445877 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-cb0ea98b-80eb-43b2-b4ce-53672c3f661a tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:52.446467 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-cb0ea98b-80eb-43b2-b4ce-53672c3f661a tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:52.453368 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cb0ea98b-80eb-43b2-b4ce-53672c3f661a tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:52.453847 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cb0ea98b-80eb-43b2-b4ce-53672c3f661a tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:52.454275 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cb0ea98b-80eb-43b2-b4ce-53672c3f661a tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:52.454994 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cb0ea98b-80eb-43b2-b4ce-53672c3f661a tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:52.455437 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cb0ea98b-80eb-43b2-b4ce-53672c3f661a tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:52.456095 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cb0ea98b-80eb-43b2-b4ce-53672c3f661a tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:52.472198 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-5b830273-09dd-4ff2-96cc-83503aa7c122 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:52.472800 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-5b830273-09dd-4ff2-96cc-83503aa7c122 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:52.479280 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5b830273-09dd-4ff2-96cc-83503aa7c122 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:52.480022 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5b830273-09dd-4ff2-96cc-83503aa7c122 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:52.480649 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5b830273-09dd-4ff2-96cc-83503aa7c122 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:52.481344 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5b830273-09dd-4ff2-96cc-83503aa7c122 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:52.481786 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5b830273-09dd-4ff2-96cc-83503aa7c122 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:52.482204 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5b830273-09dd-4ff2-96cc-83503aa7c122 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:52.648877 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-cb0ea98b-80eb-43b2-b4ce-53672c3f661a tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:52.659121 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-cb0ea98b-80eb-43b2-b4ce-53672c3f661a tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1313 microversion: 2.1 time: 0.217006 Oct 24 08:49:52.659757 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 172/339] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:52 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:52.667835 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-b9a5d156-4491-4846-8765-ed90b6e1c156 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:52.668714 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-b9a5d156-4491-4846-8765-ed90b6e1c156 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f2772d7f-d505-44ab-a062-58bd88bd49d3] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:52.672344 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-5b830273-09dd-4ff2-96cc-83503aa7c122 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:52.676909 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b9a5d156-4491-4846-8765-ed90b6e1c156 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:52.677617 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b9a5d156-4491-4846-8765-ed90b6e1c156 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:52.678526 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b9a5d156-4491-4846-8765-ed90b6e1c156 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:52.679444 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b9a5d156-4491-4846-8765-ed90b6e1c156 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:52.680095 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b9a5d156-4491-4846-8765-ed90b6e1c156 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:52.680237 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-5b830273-09dd-4ff2-96cc-83503aa7c122 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1358 microversion: 2.1 time: 0.211877 Oct 24 08:49:52.680802 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 168/340] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:52 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:52.680935 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b9a5d156-4491-4846-8765-ed90b6e1c156 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:52.812837 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-b9a5d156-4491-4846-8765-ed90b6e1c156 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:52.820539 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-b9a5d156-4491-4846-8765-ed90b6e1c156 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3" status: 200 len: 1522 microversion: 2.1 time: 0.159426 Oct 24 08:49:52.821098 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 173/341] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:52 2022] GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:53.687542 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-5292bebe-e196-4354-a588-465a6ba3eee6 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:53.688513 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-5292bebe-e196-4354-a588-465a6ba3eee6 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:53.698600 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5292bebe-e196-4354-a588-465a6ba3eee6 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:53.699164 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5292bebe-e196-4354-a588-465a6ba3eee6 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:53.699596 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5292bebe-e196-4354-a588-465a6ba3eee6 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:53.700268 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5292bebe-e196-4354-a588-465a6ba3eee6 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:53.700710 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5292bebe-e196-4354-a588-465a6ba3eee6 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:53.701129 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5292bebe-e196-4354-a588-465a6ba3eee6 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:53.703791 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell1:SELECT=100 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:49:53.704886 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-3955d265-772f-4871-91b3-22ae29cfe628 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:53.705500 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-3955d265-772f-4871-91b3-22ae29cfe628 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:53.712109 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3955d265-772f-4871-91b3-22ae29cfe628 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:53.712591 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3955d265-772f-4871-91b3-22ae29cfe628 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:53.713033 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3955d265-772f-4871-91b3-22ae29cfe628 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:53.713709 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3955d265-772f-4871-91b3-22ae29cfe628 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:53.714159 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3955d265-772f-4871-91b3-22ae29cfe628 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:53.714575 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3955d265-772f-4871-91b3-22ae29cfe628 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:53.898564 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-3955d265-772f-4871-91b3-22ae29cfe628 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:53.906151 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-5292bebe-e196-4354-a588-465a6ba3eee6 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:53.907483 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-3955d265-772f-4871-91b3-22ae29cfe628 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1358 microversion: 2.1 time: 0.206711 Oct 24 08:49:53.908298 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 174/342] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:53 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:53.913926 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-fb0f5886-bad9-44a9-a34c-e2d676c0ee0b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:53.914693 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-fb0f5886-bad9-44a9-a34c-e2d676c0ee0b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f2772d7f-d505-44ab-a062-58bd88bd49d3] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:53.921433 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-fb0f5886-bad9-44a9-a34c-e2d676c0ee0b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:53.921915 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-fb0f5886-bad9-44a9-a34c-e2d676c0ee0b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:53.922773 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-fb0f5886-bad9-44a9-a34c-e2d676c0ee0b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:53.923942 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-fb0f5886-bad9-44a9-a34c-e2d676c0ee0b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:53.924497 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-fb0f5886-bad9-44a9-a34c-e2d676c0ee0b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:53.924973 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-fb0f5886-bad9-44a9-a34c-e2d676c0ee0b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:53.932067 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-5292bebe-e196-4354-a588-465a6ba3eee6 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1313 microversion: 2.1 time: 0.250759 Oct 24 08:49:53.932664 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 169/343] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:53 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:54.108785 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-fb0f5886-bad9-44a9-a34c-e2d676c0ee0b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:54.118199 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-fb0f5886-bad9-44a9-a34c-e2d676c0ee0b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3" status: 200 len: 1522 microversion: 2.1 time: 0.208299 Oct 24 08:49:54.118830 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 175/344] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:53 2022] GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:54.329582 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-ce8ddc28-af16-4137-b3b8-f1c66f8e6e0d req-f05b1c8b-079e-4fad-b854-b90db60d5061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89a67761-1e03-4ede-8f59-f719d6ea20d1", "name": "network-vif-plugged", "status": "completed", "tag": "5693bb11-79fc-4a3c-bc79-8cc96cab3b00"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:49:54.350126 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-ce8ddc28-af16-4137-b3b8-f1c66f8e6e0d req-f05b1c8b-079e-4fad-b854-b90db60d5061 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:54.350990 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-ce8ddc28-af16-4137-b3b8-f1c66f8e6e0d req-f05b1c8b-079e-4fad-b854-b90db60d5061 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:54.351649 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-ce8ddc28-af16-4137-b3b8-f1c66f8e6e0d req-f05b1c8b-079e-4fad-b854-b90db60d5061 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:54.382491 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-ce8ddc28-af16-4137-b3b8-f1c66f8e6e0d req-f05b1c8b-079e-4fad-b854-b90db60d5061 service nova] Creating event network-vif-plugged:5693bb11-79fc-4a3c-bc79-8cc96cab3b00 for instance 89a67761-1e03-4ede-8f59-f719d6ea20d1 on hv-cinder-maste Oct 24 08:49:54.397328 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-ce8ddc28-af16-4137-b3b8-f1c66f8e6e0d req-f05b1c8b-079e-4fad-b854-b90db60d5061 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072029 Oct 24 08:49:54.400249 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 170/345] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:49:54.936631 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-57d6757f-2a80-42ed-83a4-59eea0271fe1 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:54.937261 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-57d6757f-2a80-42ed-83a4-59eea0271fe1 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:54.945863 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-57d6757f-2a80-42ed-83a4-59eea0271fe1 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:54.946535 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-57d6757f-2a80-42ed-83a4-59eea0271fe1 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:54.947001 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-57d6757f-2a80-42ed-83a4-59eea0271fe1 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:54.948015 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-57d6757f-2a80-42ed-83a4-59eea0271fe1 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:54.948568 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-57d6757f-2a80-42ed-83a4-59eea0271fe1 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:54.949138 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-57d6757f-2a80-42ed-83a4-59eea0271fe1 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:54.959447 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-5ffbd6e1-d4cd-4037-99f3-05d6e9447de8 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:54.960144 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-5ffbd6e1-d4cd-4037-99f3-05d6e9447de8 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:54.975660 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5ffbd6e1-d4cd-4037-99f3-05d6e9447de8 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:54.976404 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5ffbd6e1-d4cd-4037-99f3-05d6e9447de8 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:54.977013 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5ffbd6e1-d4cd-4037-99f3-05d6e9447de8 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:54.978163 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5ffbd6e1-d4cd-4037-99f3-05d6e9447de8 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:54.978853 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5ffbd6e1-d4cd-4037-99f3-05d6e9447de8 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:54.979922 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5ffbd6e1-d4cd-4037-99f3-05d6e9447de8 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:55.129139 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-57d6757f-2a80-42ed-83a4-59eea0271fe1 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:55.141117 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-57d6757f-2a80-42ed-83a4-59eea0271fe1 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1358 microversion: 2.1 time: 0.209666 Oct 24 08:49:55.141695 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 176/346] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:54 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1358 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:55.147243 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-fe851fd8-eabe-459a-95ae-5f4cacc38b01 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:55.148055 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-fe851fd8-eabe-459a-95ae-5f4cacc38b01 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f2772d7f-d505-44ab-a062-58bd88bd49d3] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:55.154467 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-fe851fd8-eabe-459a-95ae-5f4cacc38b01 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:55.155326 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-fe851fd8-eabe-459a-95ae-5f4cacc38b01 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:55.155730 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-fe851fd8-eabe-459a-95ae-5f4cacc38b01 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:55.157056 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-fe851fd8-eabe-459a-95ae-5f4cacc38b01 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:55.157750 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-fe851fd8-eabe-459a-95ae-5f4cacc38b01 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:55.158174 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-fe851fd8-eabe-459a-95ae-5f4cacc38b01 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:55.176058 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-5ffbd6e1-d4cd-4037-99f3-05d6e9447de8 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:55.186369 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-5ffbd6e1-d4cd-4037-99f3-05d6e9447de8 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1313 microversion: 2.1 time: 0.230947 Oct 24 08:49:55.187299 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 171/347] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:54 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:55.295646 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-fe851fd8-eabe-459a-95ae-5f4cacc38b01 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:55.303700 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-fe851fd8-eabe-459a-95ae-5f4cacc38b01 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3" status: 200 len: 1522 microversion: 2.1 time: 0.160797 Oct 24 08:49:55.304366 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 177/348] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:55 2022] GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:56.163525 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-cca229eb-a3eb-4de2-9f79-44e5ce68e741 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:56.164140 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-cca229eb-a3eb-4de2-9f79-44e5ce68e741 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:56.172520 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cca229eb-a3eb-4de2-9f79-44e5ce68e741 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:56.173019 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cca229eb-a3eb-4de2-9f79-44e5ce68e741 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:56.173456 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cca229eb-a3eb-4de2-9f79-44e5ce68e741 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:56.174515 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cca229eb-a3eb-4de2-9f79-44e5ce68e741 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:56.175008 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cca229eb-a3eb-4de2-9f79-44e5ce68e741 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:56.175454 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cca229eb-a3eb-4de2-9f79-44e5ce68e741 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:56.208785 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-7708bd9a-1447-4da2-9524-42c3383e7b25 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:56.211187 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-7708bd9a-1447-4da2-9524-42c3383e7b25 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:56.222744 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7708bd9a-1447-4da2-9524-42c3383e7b25 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:56.223654 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7708bd9a-1447-4da2-9524-42c3383e7b25 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:56.224577 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7708bd9a-1447-4da2-9524-42c3383e7b25 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:56.225491 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7708bd9a-1447-4da2-9524-42c3383e7b25 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:56.226023 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7708bd9a-1447-4da2-9524-42c3383e7b25 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:56.226513 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7708bd9a-1447-4da2-9524-42c3383e7b25 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:56.405261 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-cca229eb-a3eb-4de2-9f79-44e5ce68e741 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:56.416544 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-cca229eb-a3eb-4de2-9f79-44e5ce68e741 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1358 microversion: 2.1 time: 0.256314 Oct 24 08:49:56.417978 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 172/349] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:56 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1358 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:56.424171 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-a2f45bb5-6623-4ffc-bae8-3d09d769e7fe tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:56.425103 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-a2f45bb5-6623-4ffc-bae8-3d09d769e7fe tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f2772d7f-d505-44ab-a062-58bd88bd49d3] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:56.433773 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a2f45bb5-6623-4ffc-bae8-3d09d769e7fe tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:56.435088 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a2f45bb5-6623-4ffc-bae8-3d09d769e7fe tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:56.436590 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a2f45bb5-6623-4ffc-bae8-3d09d769e7fe tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:56.437381 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a2f45bb5-6623-4ffc-bae8-3d09d769e7fe tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:56.437892 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a2f45bb5-6623-4ffc-bae8-3d09d769e7fe tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:56.438421 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a2f45bb5-6623-4ffc-bae8-3d09d769e7fe tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:56.448941 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-7708bd9a-1447-4da2-9524-42c3383e7b25 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:56.458484 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-7708bd9a-1447-4da2-9524-42c3383e7b25 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1313 microversion: 2.1 time: 0.253477 Oct 24 08:49:56.459143 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 178/350] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:56 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:49:56.598935 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a2f45bb5-6623-4ffc-bae8-3d09d769e7fe tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:56.606801 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-a2f45bb5-6623-4ffc-bae8-3d09d769e7fe tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3" status: 200 len: 1522 microversion: 2.1 time: 0.187492 Oct 24 08:49:56.607362 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 173/351] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:56 2022] GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:57.442650 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-bfb41e7f-8267-4ece-9482-2895a18a83af tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:57.443285 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-bfb41e7f-8267-4ece-9482-2895a18a83af tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:57.450151 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bfb41e7f-8267-4ece-9482-2895a18a83af tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:57.450606 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bfb41e7f-8267-4ece-9482-2895a18a83af tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:57.451087 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bfb41e7f-8267-4ece-9482-2895a18a83af tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:57.451748 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bfb41e7f-8267-4ece-9482-2895a18a83af tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:57.452187 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bfb41e7f-8267-4ece-9482-2895a18a83af tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:57.452601 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bfb41e7f-8267-4ece-9482-2895a18a83af tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:57.481619 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-04d93bc8-ad5b-4ef1-a6db-006b3ebd0969 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:57.482869 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-04d93bc8-ad5b-4ef1-a6db-006b3ebd0969 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:57.489082 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-04d93bc8-ad5b-4ef1-a6db-006b3ebd0969 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:57.489559 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-04d93bc8-ad5b-4ef1-a6db-006b3ebd0969 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:57.489988 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-04d93bc8-ad5b-4ef1-a6db-006b3ebd0969 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:57.490694 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-04d93bc8-ad5b-4ef1-a6db-006b3ebd0969 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:57.491332 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-04d93bc8-ad5b-4ef1-a6db-006b3ebd0969 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:57.491749 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-04d93bc8-ad5b-4ef1-a6db-006b3ebd0969 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:57.640329 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-bfb41e7f-8267-4ece-9482-2895a18a83af tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:57.648323 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-bfb41e7f-8267-4ece-9482-2895a18a83af tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1547 microversion: 2.1 time: 0.209384 Oct 24 08:49:57.648888 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 179/352] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:57 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1547 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:57.653530 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-f16f08be-644c-4b14-8f7d-27623ce7fdd3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:57.654313 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-f16f08be-644c-4b14-8f7d-27623ce7fdd3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f2772d7f-d505-44ab-a062-58bd88bd49d3] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:57.660137 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f16f08be-644c-4b14-8f7d-27623ce7fdd3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:57.660617 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f16f08be-644c-4b14-8f7d-27623ce7fdd3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:57.661043 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f16f08be-644c-4b14-8f7d-27623ce7fdd3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:57.661721 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f16f08be-644c-4b14-8f7d-27623ce7fdd3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:57.662161 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f16f08be-644c-4b14-8f7d-27623ce7fdd3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:57.662569 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f16f08be-644c-4b14-8f7d-27623ce7fdd3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:57.670786 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-04d93bc8-ad5b-4ef1-a6db-006b3ebd0969 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:57.679810 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-04d93bc8-ad5b-4ef1-a6db-006b3ebd0969 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1313 microversion: 2.1 time: 0.202419 Oct 24 08:49:57.680579 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 174/353] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:57 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:49:57.686183 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-d69d82ba-ab6a-4901-baba-583c409f4b72 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:57.687433 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-d69d82ba-ab6a-4901-baba-583c409f4b72 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:57.693392 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d69d82ba-ab6a-4901-baba-583c409f4b72 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:57.694083 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d69d82ba-ab6a-4901-baba-583c409f4b72 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:57.694508 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d69d82ba-ab6a-4901-baba-583c409f4b72 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:57.695323 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d69d82ba-ab6a-4901-baba-583c409f4b72 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:57.695839 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d69d82ba-ab6a-4901-baba-583c409f4b72 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:57.696328 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d69d82ba-ab6a-4901-baba-583c409f4b72 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:57.881618 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-f16f08be-644c-4b14-8f7d-27623ce7fdd3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:57.886607 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-d69d82ba-ab6a-4901-baba-583c409f4b72 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:57.889372 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-f16f08be-644c-4b14-8f7d-27623ce7fdd3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3" status: 200 len: 1522 microversion: 2.1 time: 0.239324 Oct 24 08:49:57.889953 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 180/354] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:57 2022] GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:57.895532 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-d69d82ba-ab6a-4901-baba-583c409f4b72 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1547 microversion: 2.1 time: 0.213725 Oct 24 08:49:57.896222 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 175/355] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:57 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1547 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:57.918289 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-ea0cf61a-fb0f-4b3f-a8a4-71d5174cb018 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:57.923706 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-ea0cf61a-fb0f-4b3f-a8a4-71d5174cb018 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:57.924485 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-ea0cf61a-fb0f-4b3f-a8a4-71d5174cb018 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Searching by: {'deleted': False, 'project_id': '238b1450574c411682599a39ad0a8371'} {{(pid=125164) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 08:49:57.931394 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ea0cf61a-fb0f-4b3f-a8a4-71d5174cb018 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:57.931907 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ea0cf61a-fb0f-4b3f-a8a4-71d5174cb018 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:57.932489 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ea0cf61a-fb0f-4b3f-a8a4-71d5174cb018 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:57.933187 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ea0cf61a-fb0f-4b3f-a8a4-71d5174cb018 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:57.933640 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ea0cf61a-fb0f-4b3f-a8a4-71d5174cb018 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:57.934066 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ea0cf61a-fb0f-4b3f-a8a4-71d5174cb018 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:58.029212 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.multi_cell_list [None req-ea0cf61a-fb0f-4b3f-a8a4-71d5174cb018 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125164) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 08:49:58.116746 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-ea0cf61a-fb0f-4b3f-a8a4-71d5174cb018 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.202466 Oct 24 08:49:58.117366 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 181/356] 10.222.0.26 () {58 vars in 1125 bytes} [Mon Oct 24 08:49:57 2022] GET /compute/v2.1/servers => generated 342 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:49:58.128882 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-89d032d7-938e-42b2-8ef6-f08cbcb5d9c2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:58.129500 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-89d032d7-938e-42b2-8ef6-f08cbcb5d9c2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:58.135606 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-89d032d7-938e-42b2-8ef6-f08cbcb5d9c2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:58.136230 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-89d032d7-938e-42b2-8ef6-f08cbcb5d9c2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:58.136519 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-89d032d7-938e-42b2-8ef6-f08cbcb5d9c2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:58.137303 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-89d032d7-938e-42b2-8ef6-f08cbcb5d9c2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:58.137642 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-89d032d7-938e-42b2-8ef6-f08cbcb5d9c2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:58.138067 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-89d032d7-938e-42b2-8ef6-f08cbcb5d9c2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:58.266707 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-89d032d7-938e-42b2-8ef6-f08cbcb5d9c2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:58.274816 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-89d032d7-938e-42b2-8ef6-f08cbcb5d9c2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1547 microversion: 2.1 time: 0.149557 Oct 24 08:49:58.275225 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 176/357] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:58 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:58.467520 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-b2c9b30f-82f3-4357-8b67-b7baf5a525bc req-af06b346-e5c0-4810-88bc-2ede4b81a855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0481f739-3230-4857-b001-c94f5ac479e8", "name": "network-vif-plugged", "status": "completed", "tag": "ee0013da-988a-43dc-b8d5-a9b2a49275bd"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:49:58.482444 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-b2c9b30f-82f3-4357-8b67-b7baf5a525bc req-af06b346-e5c0-4810-88bc-2ede4b81a855 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:58.483114 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-b2c9b30f-82f3-4357-8b67-b7baf5a525bc req-af06b346-e5c0-4810-88bc-2ede4b81a855 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:58.483708 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-b2c9b30f-82f3-4357-8b67-b7baf5a525bc req-af06b346-e5c0-4810-88bc-2ede4b81a855 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:58.514838 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-b2c9b30f-82f3-4357-8b67-b7baf5a525bc req-af06b346-e5c0-4810-88bc-2ede4b81a855 service nova] Creating event network-vif-plugged:ee0013da-988a-43dc-b8d5-a9b2a49275bd for instance 0481f739-3230-4857-b001-c94f5ac479e8 on hv-cinder-maste Oct 24 08:49:58.531614 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-b2c9b30f-82f3-4357-8b67-b7baf5a525bc req-af06b346-e5c0-4810-88bc-2ede4b81a855 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064746 Oct 24 08:49:58.532347 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 182/358] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:49:58.716614 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-a35e09ee-4aa4-4550-8eb7-3c430741c13b tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:58.717286 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-a35e09ee-4aa4-4550-8eb7-3c430741c13b tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:58.724424 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a35e09ee-4aa4-4550-8eb7-3c430741c13b tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:58.724894 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a35e09ee-4aa4-4550-8eb7-3c430741c13b tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:58.725363 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a35e09ee-4aa4-4550-8eb7-3c430741c13b tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:58.726054 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a35e09ee-4aa4-4550-8eb7-3c430741c13b tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:58.726487 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a35e09ee-4aa4-4550-8eb7-3c430741c13b tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:58.726944 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a35e09ee-4aa4-4550-8eb7-3c430741c13b tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:58.860031 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a35e09ee-4aa4-4550-8eb7-3c430741c13b tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:58.871916 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-a35e09ee-4aa4-4550-8eb7-3c430741c13b tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1313 microversion: 2.1 time: 0.172153 Oct 24 08:49:58.872697 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 177/359] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:58 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:58.915787 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-0ccbcf6b-dd3e-47c6-95d5-3fee77c88538 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:58.917314 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-0ccbcf6b-dd3e-47c6-95d5-3fee77c88538 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f2772d7f-d505-44ab-a062-58bd88bd49d3] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:58.924486 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0ccbcf6b-dd3e-47c6-95d5-3fee77c88538 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:58.924974 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0ccbcf6b-dd3e-47c6-95d5-3fee77c88538 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:58.925428 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0ccbcf6b-dd3e-47c6-95d5-3fee77c88538 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:58.926120 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0ccbcf6b-dd3e-47c6-95d5-3fee77c88538 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:58.926633 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0ccbcf6b-dd3e-47c6-95d5-3fee77c88538 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:58.927210 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0ccbcf6b-dd3e-47c6-95d5-3fee77c88538 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:58.946638 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:49:59.065190 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-0ccbcf6b-dd3e-47c6-95d5-3fee77c88538 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:49:59.073252 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-0ccbcf6b-dd3e-47c6-95d5-3fee77c88538 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3" status: 200 len: 1522 microversion: 2.1 time: 0.164173 Oct 24 08:49:59.073802 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 183/360] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:58 2022] GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:49:59.895224 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-3085d8af-c1ea-4a67-98a8-c557597eb612 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:49:59.895850 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-3085d8af-c1ea-4a67-98a8-c557597eb612 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:59.905433 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3085d8af-c1ea-4a67-98a8-c557597eb612 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:59.906862 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3085d8af-c1ea-4a67-98a8-c557597eb612 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:59.907380 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3085d8af-c1ea-4a67-98a8-c557597eb612 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:59.908409 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3085d8af-c1ea-4a67-98a8-c557597eb612 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:59.908876 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3085d8af-c1ea-4a67-98a8-c557597eb612 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:59.909282 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3085d8af-c1ea-4a67-98a8-c557597eb612 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:59.968094 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-3a70a18d-e4ec-40ec-b301-a02bb8efad01 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9463451-a0d9-48de-9a2e-d79819875aa5"}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:49:59.970934 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-3a70a18d-e4ec-40ec-b301-a02bb8efad01 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:49:59.977596 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3a70a18d-e4ec-40ec-b301-a02bb8efad01 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:59.978398 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3a70a18d-e4ec-40ec-b301-a02bb8efad01 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:59.979065 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3a70a18d-e4ec-40ec-b301-a02bb8efad01 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:49:59.979861 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3a70a18d-e4ec-40ec-b301-a02bb8efad01 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:49:59.980974 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3a70a18d-e4ec-40ec-b301-a02bb8efad01 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:49:59.981591 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3a70a18d-e4ec-40ec-b301-a02bb8efad01 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:00.052375 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-3085d8af-c1ea-4a67-98a8-c557597eb612 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:00.062307 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-3085d8af-c1ea-4a67-98a8-c557597eb612 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1313 microversion: 2.1 time: 0.170926 Oct 24 08:50:00.063667 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 178/361] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:49:59 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:00.096223 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-15cd3e9d-456c-48ba-8d36-b70234e6fcca tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:00.096999 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-15cd3e9d-456c-48ba-8d36-b70234e6fcca tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f2772d7f-d505-44ab-a062-58bd88bd49d3] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:00.103071 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-15cd3e9d-456c-48ba-8d36-b70234e6fcca tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:00.103699 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-15cd3e9d-456c-48ba-8d36-b70234e6fcca tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:00.104007 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-15cd3e9d-456c-48ba-8d36-b70234e6fcca tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:00.104738 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-15cd3e9d-456c-48ba-8d36-b70234e6fcca tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:00.105171 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-15cd3e9d-456c-48ba-8d36-b70234e6fcca tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:00.105585 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-15cd3e9d-456c-48ba-8d36-b70234e6fcca tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:00.333042 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-15cd3e9d-456c-48ba-8d36-b70234e6fcca tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:00.340428 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-3a70a18d-e4ec-40ec-b301-a02bb8efad01 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "POST /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.377270 Oct 24 08:50:00.341233 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 184/362] 10.222.0.26 () {60 vars in 1323 bytes} [Mon Oct 24 08:49:59 2022] POST /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1/os-volume_attachments => generated 194 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:50:00.341344 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-15cd3e9d-456c-48ba-8d36-b70234e6fcca tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3" status: 200 len: 1522 microversion: 2.1 time: 0.248972 Oct 24 08:50:00.342029 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 179/363] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:00 2022] GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:50:01.086410 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-9ba21963-a2ab-4e9f-9b97-4c6a3bf6eb46 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:01.087300 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-9ba21963-a2ab-4e9f-9b97-4c6a3bf6eb46 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:01.094859 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9ba21963-a2ab-4e9f-9b97-4c6a3bf6eb46 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:01.095330 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9ba21963-a2ab-4e9f-9b97-4c6a3bf6eb46 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:01.095823 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9ba21963-a2ab-4e9f-9b97-4c6a3bf6eb46 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:01.096918 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9ba21963-a2ab-4e9f-9b97-4c6a3bf6eb46 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:01.098060 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9ba21963-a2ab-4e9f-9b97-4c6a3bf6eb46 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:01.098550 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9ba21963-a2ab-4e9f-9b97-4c6a3bf6eb46 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:01.252513 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-9ba21963-a2ab-4e9f-9b97-4c6a3bf6eb46 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:01.261373 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-9ba21963-a2ab-4e9f-9b97-4c6a3bf6eb46 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1497 microversion: 2.1 time: 0.179571 Oct 24 08:50:01.261947 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 185/364] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:01 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1497 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:01.369281 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-6ed3e759-e6fe-4131-9541-915b63bf05c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:01.370274 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-6ed3e759-e6fe-4131-9541-915b63bf05c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f2772d7f-d505-44ab-a062-58bd88bd49d3] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:01.380554 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6ed3e759-e6fe-4131-9541-915b63bf05c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:01.381347 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6ed3e759-e6fe-4131-9541-915b63bf05c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:01.382064 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6ed3e759-e6fe-4131-9541-915b63bf05c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:01.383233 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6ed3e759-e6fe-4131-9541-915b63bf05c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:01.383967 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6ed3e759-e6fe-4131-9541-915b63bf05c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:01.384669 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6ed3e759-e6fe-4131-9541-915b63bf05c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:01.516992 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-6ed3e759-e6fe-4131-9541-915b63bf05c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:01.528137 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-6ed3e759-e6fe-4131-9541-915b63bf05c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3" status: 200 len: 1522 microversion: 2.1 time: 0.165355 Oct 24 08:50:01.528709 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 180/365] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:01 2022] GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:02.216258 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-fd7283ab-af3c-4788-b79a-9bcfc93c05e3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:02.216771 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-fd7283ab-af3c-4788-b79a-9bcfc93c05e3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:02.223312 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-fd7283ab-af3c-4788-b79a-9bcfc93c05e3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:02.223794 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-fd7283ab-af3c-4788-b79a-9bcfc93c05e3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:02.224223 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-fd7283ab-af3c-4788-b79a-9bcfc93c05e3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:02.224897 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-fd7283ab-af3c-4788-b79a-9bcfc93c05e3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:02.225340 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-fd7283ab-af3c-4788-b79a-9bcfc93c05e3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:02.225756 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-fd7283ab-af3c-4788-b79a-9bcfc93c05e3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:02.250879 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-fd7283ab-af3c-4788-b79a-9bcfc93c05e3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Going to try to terminate instance {{(pid=125164) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:50:02.336909 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-fd7283ab-af3c-4788-b79a-9bcfc93c05e3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 204 len: 0 microversion: 2.1 time: 0.124336 Oct 24 08:50:02.337521 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 186/366] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Oct 24 08:50:02 2022] DELETE /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:50:02.345918 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-e2cf639f-b54e-4bc1-968b-7d042034ef96 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:02.346906 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-e2cf639f-b54e-4bc1-968b-7d042034ef96 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:02.353209 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e2cf639f-b54e-4bc1-968b-7d042034ef96 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:02.353691 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e2cf639f-b54e-4bc1-968b-7d042034ef96 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:02.354305 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e2cf639f-b54e-4bc1-968b-7d042034ef96 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:02.355120 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e2cf639f-b54e-4bc1-968b-7d042034ef96 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:02.355553 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e2cf639f-b54e-4bc1-968b-7d042034ef96 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:02.355976 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e2cf639f-b54e-4bc1-968b-7d042034ef96 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:02.498871 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-e2cf639f-b54e-4bc1-968b-7d042034ef96 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:02.506596 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-e2cf639f-b54e-4bc1-968b-7d042034ef96 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1503 microversion: 2.1 time: 0.164722 Oct 24 08:50:02.507538 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 181/367] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:02 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:02.551347 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-b064ce40-3a94-4049-bd80-0ceaf8e975c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:02.552034 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-b064ce40-3a94-4049-bd80-0ceaf8e975c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f2772d7f-d505-44ab-a062-58bd88bd49d3] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:02.557878 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b064ce40-3a94-4049-bd80-0ceaf8e975c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:02.558452 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b064ce40-3a94-4049-bd80-0ceaf8e975c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:02.558907 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b064ce40-3a94-4049-bd80-0ceaf8e975c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:02.559581 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b064ce40-3a94-4049-bd80-0ceaf8e975c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:02.560026 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b064ce40-3a94-4049-bd80-0ceaf8e975c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:02.560438 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b064ce40-3a94-4049-bd80-0ceaf8e975c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:02.706699 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-b064ce40-3a94-4049-bd80-0ceaf8e975c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:02.714518 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-b064ce40-3a94-4049-bd80-0ceaf8e975c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3" status: 200 len: 1522 microversion: 2.1 time: 0.167408 Oct 24 08:50:02.715306 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 187/368] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:02 2022] GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:03.530627 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-55abf895-23ee-4a9c-a74a-b4470c8d6056 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:03.531495 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-55abf895-23ee-4a9c-a74a-b4470c8d6056 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:03.538948 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-55abf895-23ee-4a9c-a74a-b4470c8d6056 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:03.539471 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-55abf895-23ee-4a9c-a74a-b4470c8d6056 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:03.539906 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-55abf895-23ee-4a9c-a74a-b4470c8d6056 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:03.540607 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-55abf895-23ee-4a9c-a74a-b4470c8d6056 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:03.541052 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-55abf895-23ee-4a9c-a74a-b4470c8d6056 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:03.542107 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-55abf895-23ee-4a9c-a74a-b4470c8d6056 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:03.676311 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-55abf895-23ee-4a9c-a74a-b4470c8d6056 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:03.686670 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-55abf895-23ee-4a9c-a74a-b4470c8d6056 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1503 microversion: 2.1 time: 0.160704 Oct 24 08:50:03.687268 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 182/369] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:03 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:03.737374 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-3683dd0b-1511-461f-baec-f778176c72a6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:03.737953 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-3683dd0b-1511-461f-baec-f778176c72a6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f2772d7f-d505-44ab-a062-58bd88bd49d3] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:03.745049 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3683dd0b-1511-461f-baec-f778176c72a6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:03.745541 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3683dd0b-1511-461f-baec-f778176c72a6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:03.745976 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3683dd0b-1511-461f-baec-f778176c72a6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:03.746674 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3683dd0b-1511-461f-baec-f778176c72a6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:03.747412 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3683dd0b-1511-461f-baec-f778176c72a6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:03.747828 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3683dd0b-1511-461f-baec-f778176c72a6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:03.881927 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-3683dd0b-1511-461f-baec-f778176c72a6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:03.889918 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-3683dd0b-1511-461f-baec-f778176c72a6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3" status: 200 len: 1522 microversion: 2.1 time: 0.156485 Oct 24 08:50:03.890495 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 188/370] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:03 2022] GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:04.712581 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-b414ac6f-4e7b-467f-b677-9a36100f0aec tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:04.713186 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-b414ac6f-4e7b-467f-b677-9a36100f0aec tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:04.720080 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b414ac6f-4e7b-467f-b677-9a36100f0aec tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:04.720571 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b414ac6f-4e7b-467f-b677-9a36100f0aec tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:04.721042 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b414ac6f-4e7b-467f-b677-9a36100f0aec tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:04.721756 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b414ac6f-4e7b-467f-b677-9a36100f0aec tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:04.722233 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b414ac6f-4e7b-467f-b677-9a36100f0aec tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:04.722614 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b414ac6f-4e7b-467f-b677-9a36100f0aec tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:04.878286 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-b414ac6f-4e7b-467f-b677-9a36100f0aec tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:04.887667 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-b414ac6f-4e7b-467f-b677-9a36100f0aec tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1503 microversion: 2.1 time: 0.179091 Oct 24 08:50:04.889272 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 183/371] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:04 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1503 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:04.913412 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-bb2f9aa0-1d17-4417-bae0-1f720e62885b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:04.914009 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-bb2f9aa0-1d17-4417-bae0-1f720e62885b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f2772d7f-d505-44ab-a062-58bd88bd49d3] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:04.920815 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bb2f9aa0-1d17-4417-bae0-1f720e62885b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:04.921286 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bb2f9aa0-1d17-4417-bae0-1f720e62885b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:04.921895 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bb2f9aa0-1d17-4417-bae0-1f720e62885b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:04.922770 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bb2f9aa0-1d17-4417-bae0-1f720e62885b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:04.923218 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bb2f9aa0-1d17-4417-bae0-1f720e62885b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:04.923631 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bb2f9aa0-1d17-4417-bae0-1f720e62885b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:05.078257 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-bb2f9aa0-1d17-4417-bae0-1f720e62885b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:05.086825 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-bb2f9aa0-1d17-4417-bae0-1f720e62885b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3" status: 200 len: 1522 microversion: 2.1 time: 0.177206 Oct 24 08:50:05.087847 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 189/372] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:04 2022] GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:05.154603 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-65980bfa-14ba-4c32-a79f-f8fbd8388451 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:05.155273 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-65980bfa-14ba-4c32-a79f-f8fbd8388451 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:05.161671 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-65980bfa-14ba-4c32-a79f-f8fbd8388451 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:05.162386 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-65980bfa-14ba-4c32-a79f-f8fbd8388451 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:05.162986 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-65980bfa-14ba-4c32-a79f-f8fbd8388451 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:05.163828 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-65980bfa-14ba-4c32-a79f-f8fbd8388451 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:05.164412 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-65980bfa-14ba-4c32-a79f-f8fbd8388451 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:05.164964 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-65980bfa-14ba-4c32-a79f-f8fbd8388451 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:05.313834 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-65980bfa-14ba-4c32-a79f-f8fbd8388451 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:05.323744 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-65980bfa-14ba-4c32-a79f-f8fbd8388451 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1593 microversion: 2.1 time: 0.173097 Oct 24 08:50:05.324233 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 184/373] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:05 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1593 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:05.324370 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-accc22ee-30d2-4936-a067-22250df7d700 req-2706f1b6-4869-4338-9184-d7e0e10eaa58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0481f739-3230-4857-b001-c94f5ac479e8", "name": "network-vif-deleted", "tag": "ee0013da-988a-43dc-b8d5-a9b2a49275bd"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:05.334229 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-accc22ee-30d2-4936-a067-22250df7d700 req-2706f1b6-4869-4338-9184-d7e0e10eaa58 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:05.334637 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-accc22ee-30d2-4936-a067-22250df7d700 req-2706f1b6-4869-4338-9184-d7e0e10eaa58 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:05.335312 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-accc22ee-30d2-4936-a067-22250df7d700 req-2706f1b6-4869-4338-9184-d7e0e10eaa58 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:05.347740 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-accc22ee-30d2-4936-a067-22250df7d700 req-2706f1b6-4869-4338-9184-d7e0e10eaa58 service nova] Creating event network-vif-deleted:ee0013da-988a-43dc-b8d5-a9b2a49275bd for instance 0481f739-3230-4857-b001-c94f5ac479e8 on hv-cinder-maste Oct 24 08:50:05.352913 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-accc22ee-30d2-4936-a067-22250df7d700 req-2706f1b6-4869-4338-9184-d7e0e10eaa58 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032935 Oct 24 08:50:05.353511 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 190/374] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:50:05.912696 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-bb45b959-8f47-4b1c-9170-1a47330f162c tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:05.913439 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-bb45b959-8f47-4b1c-9170-1a47330f162c tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:05.920471 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bb45b959-8f47-4b1c-9170-1a47330f162c tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:05.920961 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bb45b959-8f47-4b1c-9170-1a47330f162c tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:05.922103 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bb45b959-8f47-4b1c-9170-1a47330f162c tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:05.923385 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bb45b959-8f47-4b1c-9170-1a47330f162c tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:05.931855 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bb45b959-8f47-4b1c-9170-1a47330f162c tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:05.932319 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bb45b959-8f47-4b1c-9170-1a47330f162c tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:06.014039 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-bb45b959-8f47-4b1c-9170-1a47330f162c tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:06.023490 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-bb45b959-8f47-4b1c-9170-1a47330f162c tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1461 microversion: 2.1 time: 0.115937 Oct 24 08:50:06.024323 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 185/375] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:05 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1461 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:06.113900 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-e610ea6b-2442-4b9e-8010-d5b5a57e88df tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:06.114846 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-e610ea6b-2442-4b9e-8010-d5b5a57e88df tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f2772d7f-d505-44ab-a062-58bd88bd49d3] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:06.120876 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e610ea6b-2442-4b9e-8010-d5b5a57e88df tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:06.121352 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e610ea6b-2442-4b9e-8010-d5b5a57e88df tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:06.121984 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e610ea6b-2442-4b9e-8010-d5b5a57e88df tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:06.122671 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e610ea6b-2442-4b9e-8010-d5b5a57e88df tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:06.123259 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e610ea6b-2442-4b9e-8010-d5b5a57e88df tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:06.123678 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e610ea6b-2442-4b9e-8010-d5b5a57e88df tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:06.289932 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-e610ea6b-2442-4b9e-8010-d5b5a57e88df tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:06.299449 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-e610ea6b-2442-4b9e-8010-d5b5a57e88df tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3" status: 200 len: 1522 microversion: 2.1 time: 0.190261 Oct 24 08:50:06.300384 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 191/376] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:06 2022] GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:07.045918 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-29e5d521-fac3-4332-a84d-94bd298ac992 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:07.046525 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-29e5d521-fac3-4332-a84d-94bd298ac992 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:07.052597 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-29e5d521-fac3-4332-a84d-94bd298ac992 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:07.053423 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-29e5d521-fac3-4332-a84d-94bd298ac992 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:07.053963 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-29e5d521-fac3-4332-a84d-94bd298ac992 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:07.054732 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-29e5d521-fac3-4332-a84d-94bd298ac992 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:07.055252 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-29e5d521-fac3-4332-a84d-94bd298ac992 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:07.055737 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-29e5d521-fac3-4332-a84d-94bd298ac992 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:07.078244 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell1:SELECT=100 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:07.090778 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-29e5d521-fac3-4332-a84d-94bd298ac992 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:07.091510 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-29e5d521-fac3-4332-a84d-94bd298ac992 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:07.092118 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-29e5d521-fac3-4332-a84d-94bd298ac992 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:07.092736 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.objects.instance [None req-29e5d521-fac3-4332-a84d-94bd298ac992 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lazy-loading 'fault' on Instance uuid 0481f739-3230-4857-b001-c94f5ac479e8 {{(pid=125165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:50:07.148562 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-29e5d521-fac3-4332-a84d-94bd298ac992 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:07.167740 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-29e5d521-fac3-4332-a84d-94bd298ac992 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1303 microversion: 2.1 time: 0.125995 Oct 24 08:50:07.170246 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 186/377] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:07 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1303 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:07.321455 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-395454e0-f8d9-4dd7-b26b-c6499b308da7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:07.322058 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-395454e0-f8d9-4dd7-b26b-c6499b308da7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f2772d7f-d505-44ab-a062-58bd88bd49d3] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:07.328923 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-395454e0-f8d9-4dd7-b26b-c6499b308da7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:07.329409 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-395454e0-f8d9-4dd7-b26b-c6499b308da7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:07.330222 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-395454e0-f8d9-4dd7-b26b-c6499b308da7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:07.331512 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-395454e0-f8d9-4dd7-b26b-c6499b308da7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:07.332658 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-395454e0-f8d9-4dd7-b26b-c6499b308da7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:07.333083 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-395454e0-f8d9-4dd7-b26b-c6499b308da7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:07.445671 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-f3975719-c7e9-4cc9-a648-6bb3fd0e8710 req-bf982daa-ca48-4b66-936e-b277bba1a1db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89a67761-1e03-4ede-8f59-f719d6ea20d1", "tag": "5693bb11-79fc-4a3c-bc79-8cc96cab3b00"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:07.459080 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-f3975719-c7e9-4cc9-a648-6bb3fd0e8710 req-bf982daa-ca48-4b66-936e-b277bba1a1db service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:07.459937 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-f3975719-c7e9-4cc9-a648-6bb3fd0e8710 req-bf982daa-ca48-4b66-936e-b277bba1a1db service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:07.460493 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-f3975719-c7e9-4cc9-a648-6bb3fd0e8710 req-bf982daa-ca48-4b66-936e-b277bba1a1db service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:07.477136 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-f3975719-c7e9-4cc9-a648-6bb3fd0e8710 req-bf982daa-ca48-4b66-936e-b277bba1a1db service nova] Creating event network-changed:5693bb11-79fc-4a3c-bc79-8cc96cab3b00 for instance 89a67761-1e03-4ede-8f59-f719d6ea20d1 on hv-cinder-maste Oct 24 08:50:07.485682 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-f3975719-c7e9-4cc9-a648-6bb3fd0e8710 req-bf982daa-ca48-4b66-936e-b277bba1a1db service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044323 Oct 24 08:50:07.488746 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 187/378] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:50:07.517021 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-395454e0-f8d9-4dd7-b26b-c6499b308da7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:07.542115 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-395454e0-f8d9-4dd7-b26b-c6499b308da7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3" status: 200 len: 1522 microversion: 2.1 time: 0.223523 Oct 24 08:50:07.543420 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 192/379] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:07 2022] GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:08.202255 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-e4ca47f7-8680-459f-b743-dcf37b79f268 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:08.203014 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-e4ca47f7-8680-459f-b743-dcf37b79f268 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:08.218912 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e4ca47f7-8680-459f-b743-dcf37b79f268 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:08.222036 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e4ca47f7-8680-459f-b743-dcf37b79f268 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:08.222619 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e4ca47f7-8680-459f-b743-dcf37b79f268 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:08.223759 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e4ca47f7-8680-459f-b743-dcf37b79f268 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:08.224108 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e4ca47f7-8680-459f-b743-dcf37b79f268 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:08.224724 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e4ca47f7-8680-459f-b743-dcf37b79f268 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:08.276685 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e4ca47f7-8680-459f-b743-dcf37b79f268 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:08.277453 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e4ca47f7-8680-459f-b743-dcf37b79f268 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:08.278403 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e4ca47f7-8680-459f-b743-dcf37b79f268 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:08.279047 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.objects.instance [None req-e4ca47f7-8680-459f-b743-dcf37b79f268 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lazy-loading 'fault' on Instance uuid 0481f739-3230-4857-b001-c94f5ac479e8 {{(pid=125165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:50:08.351179 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-e4ca47f7-8680-459f-b743-dcf37b79f268 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:08.362017 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-e4ca47f7-8680-459f-b743-dcf37b79f268 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1303 microversion: 2.1 time: 0.171061 Oct 24 08:50:08.363002 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 188/380] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:08 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1303 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:08.563217 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell0:SELECT=2 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:08.567795 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-51465818-2d11-454a-af1d-cbb5f8cb06ae tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:08.568418 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-51465818-2d11-454a-af1d-cbb5f8cb06ae tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f2772d7f-d505-44ab-a062-58bd88bd49d3] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:08.568814 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-aa6c6015-f4af-49da-93c5-ed2296a79b4b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-180164636"}} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:08.569577 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-aa6c6015-f4af-49da-93c5-ed2296a79b4b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:08.575820 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-aa6c6015-f4af-49da-93c5-ed2296a79b4b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:08.576460 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-aa6c6015-f4af-49da-93c5-ed2296a79b4b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:08.576920 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-aa6c6015-f4af-49da-93c5-ed2296a79b4b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:08.577616 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-aa6c6015-f4af-49da-93c5-ed2296a79b4b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:08.578072 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-aa6c6015-f4af-49da-93c5-ed2296a79b4b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:08.578636 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-aa6c6015-f4af-49da-93c5-ed2296a79b4b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:08.583131 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-51465818-2d11-454a-af1d-cbb5f8cb06ae tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:08.583639 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-51465818-2d11-454a-af1d-cbb5f8cb06ae tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:08.584248 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-51465818-2d11-454a-af1d-cbb5f8cb06ae tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:08.585123 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-51465818-2d11-454a-af1d-cbb5f8cb06ae tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:08.589779 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-51465818-2d11-454a-af1d-cbb5f8cb06ae tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:08.590303 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-51465818-2d11-454a-af1d-cbb5f8cb06ae tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:08.793061 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.network.security_group_api [None req-aa6c6015-f4af-49da-93c5-ed2296a79b4b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Adding security group 64d01f25-22d2-4536-aabd-015a84643967 to port 5693bb11-79fc-4a3c-bc79-8cc96cab3b00 Oct 24 08:50:08.825096 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-51465818-2d11-454a-af1d-cbb5f8cb06ae tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:08.836910 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-51465818-2d11-454a-af1d-cbb5f8cb06ae tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3" status: 200 len: 1522 microversion: 2.1 time: 0.273881 Oct 24 08:50:08.838861 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 193/381] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:08 2022] GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:09.150114 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-aa6c6015-f4af-49da-93c5-ed2296a79b4b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "POST /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1/action" status: 202 len: 0 microversion: 2.1 time: 0.585624 Oct 24 08:50:09.154522 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 189/382] 10.222.0.26 () {60 vars in 1278 bytes} [Mon Oct 24 08:50:08 2022] POST /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1/action => generated 0 bytes in 588 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 08:50:09.157846 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-a76561bc-a71c-4f53-8982-b72fa0b83112 req-a9d0e66c-1014-4b8d-a949-91853c7ffe1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89a67761-1e03-4ede-8f59-f719d6ea20d1", "tag": "5693bb11-79fc-4a3c-bc79-8cc96cab3b00"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:09.176942 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-5a66f553-e458-455a-915e-74a5c667f2e4 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:09.176942 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-5a66f553-e458-455a-915e-74a5c667f2e4 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:09.177138 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-a76561bc-a71c-4f53-8982-b72fa0b83112 req-a9d0e66c-1014-4b8d-a949-91853c7ffe1d service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:09.177138 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-a76561bc-a71c-4f53-8982-b72fa0b83112 req-a9d0e66c-1014-4b8d-a949-91853c7ffe1d service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:09.177138 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-a76561bc-a71c-4f53-8982-b72fa0b83112 req-a9d0e66c-1014-4b8d-a949-91853c7ffe1d service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:09.180296 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-a76561bc-a71c-4f53-8982-b72fa0b83112 req-a9d0e66c-1014-4b8d-a949-91853c7ffe1d service nova] Creating event network-changed:5693bb11-79fc-4a3c-bc79-8cc96cab3b00 for instance 89a67761-1e03-4ede-8f59-f719d6ea20d1 on hv-cinder-maste Oct 24 08:50:09.185261 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5a66f553-e458-455a-915e-74a5c667f2e4 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:09.185997 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5a66f553-e458-455a-915e-74a5c667f2e4 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:09.186541 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5a66f553-e458-455a-915e-74a5c667f2e4 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:09.187375 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5a66f553-e458-455a-915e-74a5c667f2e4 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:09.187965 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-a76561bc-a71c-4f53-8982-b72fa0b83112 req-a9d0e66c-1014-4b8d-a949-91853c7ffe1d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033401 Oct 24 08:50:09.188885 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 194/383] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:50:09.189380 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5a66f553-e458-455a-915e-74a5c667f2e4 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:09.189977 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5a66f553-e458-455a-915e-74a5c667f2e4 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:09.370464 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-5a66f553-e458-455a-915e-74a5c667f2e4 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:09.381097 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-5a66f553-e458-455a-915e-74a5c667f2e4 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1639 microversion: 2.1 time: 0.220867 Oct 24 08:50:09.381703 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 190/384] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:09 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1639 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:50:09.386445 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-b73dd6f0-22a1-4137-b929-3d0bdc72f2a3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:09.387178 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-b73dd6f0-22a1-4137-b929-3d0bdc72f2a3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:09.394235 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b73dd6f0-22a1-4137-b929-3d0bdc72f2a3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:09.394432 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b73dd6f0-22a1-4137-b929-3d0bdc72f2a3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:09.394813 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b73dd6f0-22a1-4137-b929-3d0bdc72f2a3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:09.395531 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b73dd6f0-22a1-4137-b929-3d0bdc72f2a3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:09.395984 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b73dd6f0-22a1-4137-b929-3d0bdc72f2a3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:09.396408 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b73dd6f0-22a1-4137-b929-3d0bdc72f2a3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:09.428027 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b73dd6f0-22a1-4137-b929-3d0bdc72f2a3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:09.428427 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b73dd6f0-22a1-4137-b929-3d0bdc72f2a3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:09.428961 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b73dd6f0-22a1-4137-b929-3d0bdc72f2a3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:09.429413 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.objects.instance [None req-b73dd6f0-22a1-4137-b929-3d0bdc72f2a3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lazy-loading 'fault' on Instance uuid 0481f739-3230-4857-b001-c94f5ac479e8 {{(pid=125164) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:50:09.473229 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-b73dd6f0-22a1-4137-b929-3d0bdc72f2a3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1c05fbfb94433a97928fa2eb5cd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f2240b2c6a43b8a810d84065ec9d44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:09.483256 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-b73dd6f0-22a1-4137-b929-3d0bdc72f2a3 tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 200 len: 1303 microversion: 2.1 time: 0.101171 Oct 24 08:50:09.484160 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 195/385] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:09 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 1303 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:50:09.864522 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-10c23d66-09c9-4aaa-8c45-77c0de5f3387 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:09.865459 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-10c23d66-09c9-4aaa-8c45-77c0de5f3387 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f2772d7f-d505-44ab-a062-58bd88bd49d3] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:09.875427 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-10c23d66-09c9-4aaa-8c45-77c0de5f3387 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:09.875919 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-10c23d66-09c9-4aaa-8c45-77c0de5f3387 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:09.876355 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-10c23d66-09c9-4aaa-8c45-77c0de5f3387 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:09.877117 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-10c23d66-09c9-4aaa-8c45-77c0de5f3387 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:09.877572 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-10c23d66-09c9-4aaa-8c45-77c0de5f3387 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:09.877993 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-10c23d66-09c9-4aaa-8c45-77c0de5f3387 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:10.009845 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-10c23d66-09c9-4aaa-8c45-77c0de5f3387 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:10.017827 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-10c23d66-09c9-4aaa-8c45-77c0de5f3387 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3" status: 200 len: 1502 microversion: 2.1 time: 0.159069 Oct 24 08:50:10.018475 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 191/386] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:09 2022] GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3 => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:10.040472 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-d97d7a61-d4cc-477a-97b8-27fc9e0c2f7c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18eee964-da51-47d0-8de8-a3330c6db0d7"}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:10.043251 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-d97d7a61-d4cc-477a-97b8-27fc9e0c2f7c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f2772d7f-d505-44ab-a062-58bd88bd49d3] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:10.050528 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d97d7a61-d4cc-477a-97b8-27fc9e0c2f7c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:10.051042 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d97d7a61-d4cc-477a-97b8-27fc9e0c2f7c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:10.051473 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d97d7a61-d4cc-477a-97b8-27fc9e0c2f7c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:10.052159 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d97d7a61-d4cc-477a-97b8-27fc9e0c2f7c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:10.052611 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d97d7a61-d4cc-477a-97b8-27fc9e0c2f7c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:10.053014 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d97d7a61-d4cc-477a-97b8-27fc9e0c2f7c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:10.076783 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.wsgi [None req-d97d7a61-d4cc-477a-97b8-27fc9e0c2f7c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] HTTP exception thrown: Cannot 'attach_volume' instance f2772d7f-d505-44ab-a062-58bd88bd49d3 while it is in vm_state rescued Oct 24 08:50:10.078483 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-d97d7a61-d4cc-477a-97b8-27fc9e0c2f7c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Request method failure captured: Oct 24 08:50:10.078483 dv-cinder-master-3-smb devstack@n-api.service[125164]: request: POST /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3/os-volume_attachments HTTP/1.1 Oct 24 08:50:10.078483 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept: application/json Oct 24 08:50:10.078483 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept-Encoding: identity Oct 24 08:50:10.078483 dv-cinder-master-3-smb devstack@n-api.service[125164]: Connection: close Oct 24 08:50:10.078483 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Length: 74 Oct 24 08:50:10.078483 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Type: application/json Oct 24 08:50:10.078483 dv-cinder-master-3-smb devstack@n-api.service[125164]: Host: 10.222.0.26 Oct 24 08:50:10.078483 dv-cinder-master-3-smb devstack@n-api.service[125164]: Openstack-System-Scope: None Oct 24 08:50:10.078483 dv-cinder-master-3-smb devstack@n-api.service[125164]: User-Agent: python-urllib3/1.26.12 Oct 24 08:50:10.078483 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Auth-Token: gAAAAABjVlE8fgt8TlV2Xk75DOKAirPHmxhZbk5PsnSOl8uKrHSmt8vLmZl9wsWtMWHbcvrINjM9NbHEp6Z2bqeDRmCulVrREKjtNSMRyV38Pb1ReI6MoKQRPQUQO_4JYRXXssXJ145YNsyFbdDiFmugxAp3rv3PlVN7Qyts1ETOZ8colLD_vTs Oct 24 08:50:10.078483 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Id: None Oct 24 08:50:10.078483 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Name: None Oct 24 08:50:10.078483 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Identity-Status: Confirmed Oct 24 08:50:10.078483 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Is-Admin-Project: True Oct 24 08:50:10.078483 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Id: default Oct 24 08:50:10.078483 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Name: Default Oct 24 08:50:10.078483 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Id: f063c719bcda47e6874437d32d284815 Oct 24 08:50:10.078483 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-577585278 Oct 24 08:50:10.078483 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Role: reader,member Oct 24 08:50:10.078483 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Roles: reader,member Oct 24 08:50:10.080135 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f063c719bcda47e6874437d32d284815", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f063c719bcda47e6874437d32d284815"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f063c719bcda47e6874437d32d284815"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f063c719bcda47e6874437d32d284815"}]}] Oct 24 08:50:10.080135 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant: tempest-ServerRescueNegativeTestJSON-577585278 Oct 24 08:50:10.080135 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Id: f063c719bcda47e6874437d32d284815 Oct 24 08:50:10.080135 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-577585278 Oct 24 08:50:10.080135 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User: tempest-ServerRescueNegativeTestJSON-577585278-project Oct 24 08:50:10.080135 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Id: default Oct 24 08:50:10.080135 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Name: Default Oct 24 08:50:10.080135 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Id: 8695364e58b04d829b12ae1b49757536 Oct 24 08:50:10.080135 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Name: tempest-ServerRescueNegativeTestJSON-577585278-project Oct 24 08:50:10.080135 dv-cinder-master-3-smb devstack@n-api.service[125164]: Oct 24 08:50:10.080135 dv-cinder-master-3-smb devstack@n-api.service[125164]: {"volumeAttachment": {"volumeId": "18eee964-da51-47d0-8de8-a3330c6db0d7"}} Oct 24 08:50:10.080135 dv-cinder-master-3-smb devstack@n-api.service[125164]: method: > Oct 24 08:50:10.080906 dv-cinder-master-3-smb devstack@n-api.service[125164]: exception: Cannot 'attach_volume' instance f2772d7f-d505-44ab-a062-58bd88bd49d3 while it is in vm_state rescued Oct 24 08:50:10.080906 dv-cinder-master-3-smb devstack@n-api.service[125164]: action_args: {'server_id': 'f2772d7f-d505-44ab-a062-58bd88bd49d3', 'body': {'volumeAttachment': {'volumeId': '18eee964-da51-47d0-8de8-a3330c6db0d7'}}} Oct 24 08:50:10.080906 dv-cinder-master-3-smb devstack@n-api.service[125164]: {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:50:10.080906 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:10.080906 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 24 08:50:10.080906 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 24 08:50:10.080906 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 08:50:10.080906 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 08:50:10.080906 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 24 08:50:10.080906 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 24 08:50:10.080906 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f2772d7f-d505-44ab-a062-58bd88bd49d3 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 24 08:50:10.080906 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:50:10.080906 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:50:10.080906 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:50:10.080906 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:10.080906 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:50:10.080906 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:50:10.080906 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:50:10.080906 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:50:10.082012 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:50:10.082012 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:50:10.082012 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:50:10.082012 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:50:10.082012 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:50:10.082012 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:50:10.082012 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:50:10.082012 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:50:10.082012 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 24 08:50:10.082012 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 24 08:50:10.082012 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 24 08:50:10.082012 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 08:50:10.082012 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f2772d7f-d505-44ab-a062-58bd88bd49d3 while it is in vm_state rescued Oct 24 08:50:10.082012 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:50:10.082012 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:50:10.082012 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:50:10.082012 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:10.082012 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:50:10.082012 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:50:10.083129 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:50:10.083129 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:50:10.083129 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f2772d7f-d505-44ab-a062-58bd88bd49d3 while it is in vm_state rescued Oct 24 08:50:10.083129 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:50:10.083129 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-d97d7a61-d4cc-477a-97b8-27fc9e0c2f7c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Returning 409 to user: Cannot 'attach_volume' instance f2772d7f-d505-44ab-a062-58bd88bd49d3 while it is in vm_state rescued {{(pid=125164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:50:10.083129 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-d97d7a61-d4cc-477a-97b8-27fc9e0c2f7c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "POST /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043615 Oct 24 08:50:10.083129 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 196/387] 10.222.0.26 () {60 vars in 1323 bytes} [Mon Oct 24 08:50:10 2022] POST /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 08:50:10.089526 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-9d881542-53ff-4c16-8c3c-0ca0e29dedb1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:10.090063 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-9d881542-53ff-4c16-8c3c-0ca0e29dedb1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f2772d7f-d505-44ab-a062-58bd88bd49d3] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:10.097238 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9d881542-53ff-4c16-8c3c-0ca0e29dedb1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:10.097883 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9d881542-53ff-4c16-8c3c-0ca0e29dedb1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:10.098456 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9d881542-53ff-4c16-8c3c-0ca0e29dedb1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:10.099427 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9d881542-53ff-4c16-8c3c-0ca0e29dedb1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:10.099964 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9d881542-53ff-4c16-8c3c-0ca0e29dedb1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:10.100429 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9d881542-53ff-4c16-8c3c-0ca0e29dedb1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:10.168302 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-9d881542-53ff-4c16-8c3c-0ca0e29dedb1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "POST /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3/action" status: 202 len: 0 microversion: 2.1 time: 0.082647 Oct 24 08:50:10.169743 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 192/388] 10.222.0.26 () {60 vars in 1278 bytes} [Mon Oct 24 08:50:10 2022] POST /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:50:10.177498 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-d131b55d-0db1-4df3-a658-b69eedf5d6e5 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:10.178112 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-d131b55d-0db1-4df3-a658-b69eedf5d6e5 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f2772d7f-d505-44ab-a062-58bd88bd49d3] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:10.184777 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d131b55d-0db1-4df3-a658-b69eedf5d6e5 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:10.185271 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d131b55d-0db1-4df3-a658-b69eedf5d6e5 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:10.185756 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d131b55d-0db1-4df3-a658-b69eedf5d6e5 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:10.186999 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d131b55d-0db1-4df3-a658-b69eedf5d6e5 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:10.187447 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d131b55d-0db1-4df3-a658-b69eedf5d6e5 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:10.188391 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d131b55d-0db1-4df3-a658-b69eedf5d6e5 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:10.390374 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-d131b55d-0db1-4df3-a658-b69eedf5d6e5 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:10.401044 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-d131b55d-0db1-4df3-a658-b69eedf5d6e5 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3" status: 200 len: 1510 microversion: 2.1 time: 0.227379 Oct 24 08:50:10.401789 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 197/389] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:10 2022] GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3 => generated 1510 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:10.508576 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-ed7375c8-a919-40d7-b1f2-8bce4d6458bc tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:10.509315 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-ed7375c8-a919-40d7-b1f2-8bce4d6458bc tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] [instance: 0481f739-3230-4857-b001-c94f5ac479e8] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:10.516192 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ed7375c8-a919-40d7-b1f2-8bce4d6458bc tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:10.516756 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ed7375c8-a919-40d7-b1f2-8bce4d6458bc tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:10.517380 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ed7375c8-a919-40d7-b1f2-8bce4d6458bc tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:10.518155 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ed7375c8-a919-40d7-b1f2-8bce4d6458bc tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:10.518840 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ed7375c8-a919-40d7-b1f2-8bce4d6458bc tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:10.519270 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ed7375c8-a919-40d7-b1f2-8bce4d6458bc tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:10.534110 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.wsgi [None req-ed7375c8-a919-40d7-b1f2-8bce4d6458bc tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] HTTP exception thrown: Instance 0481f739-3230-4857-b001-c94f5ac479e8 could not be found. Oct 24 08:50:10.535827 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-ed7375c8-a919-40d7-b1f2-8bce4d6458bc tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Request method failure captured: Oct 24 08:50:10.535827 dv-cinder-master-3-smb devstack@n-api.service[125165]: request: GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 HTTP/1.1 Oct 24 08:50:10.535827 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept: application/json Oct 24 08:50:10.535827 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept-Encoding: identity Oct 24 08:50:10.535827 dv-cinder-master-3-smb devstack@n-api.service[125165]: Connection: close Oct 24 08:50:10.535827 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Length: 0 Oct 24 08:50:10.535827 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Type: application/json Oct 24 08:50:10.535827 dv-cinder-master-3-smb devstack@n-api.service[125165]: Host: 10.222.0.26 Oct 24 08:50:10.535827 dv-cinder-master-3-smb devstack@n-api.service[125165]: Openstack-System-Scope: None Oct 24 08:50:10.535827 dv-cinder-master-3-smb devstack@n-api.service[125165]: User-Agent: python-urllib3/1.26.12 Oct 24 08:50:10.535827 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Auth-Token: gAAAAABjVlF14N5Vs64ZxhRYZIc8T_2_EDJOWYos1FmxfUCYhqw5iqsvAYGcDrRimR2StYNsHPHyCRs-C3RHIrRVxW7f5zoB81pTUafvOHzewQslIJT8TYXiaC6CBWhJTCzwKrM3RhYt0tp300Y7lntyX24TOw-VmCzZNsTfuNxZpKlEresyGpY Oct 24 08:50:10.535827 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Id: None Oct 24 08:50:10.535827 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Name: None Oct 24 08:50:10.535827 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Identity-Status: Confirmed Oct 24 08:50:10.535827 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Is-Admin-Project: True Oct 24 08:50:10.535827 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Id: default Oct 24 08:50:10.535827 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Name: Default Oct 24 08:50:10.535827 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Id: c5f2240b2c6a43b8a810d84065ec9d44 Oct 24 08:50:10.535827 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Name: tempest-VolumesActionsTest-1970352770 Oct 24 08:50:10.535827 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Role: reader,member Oct 24 08:50:10.535827 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Roles: reader,member Oct 24 08:50:10.537064 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c5f2240b2c6a43b8a810d84065ec9d44", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c5f2240b2c6a43b8a810d84065ec9d44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5f2240b2c6a43b8a810d84065ec9d44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5f2240b2c6a43b8a810d84065ec9d44"}]}] Oct 24 08:50:10.537064 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant: tempest-VolumesActionsTest-1970352770 Oct 24 08:50:10.537064 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Id: c5f2240b2c6a43b8a810d84065ec9d44 Oct 24 08:50:10.537064 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Name: tempest-VolumesActionsTest-1970352770 Oct 24 08:50:10.537064 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User: tempest-VolumesActionsTest-1970352770-project Oct 24 08:50:10.537064 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Id: default Oct 24 08:50:10.537064 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Name: Default Oct 24 08:50:10.537064 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Id: bee1c05fbfb94433a97928fa2eb5cd15 Oct 24 08:50:10.537064 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Name: tempest-VolumesActionsTest-1970352770-project Oct 24 08:50:10.537064 dv-cinder-master-3-smb devstack@n-api.service[125165]: method: > Oct 24 08:50:10.537064 dv-cinder-master-3-smb devstack@n-api.service[125165]: exception: Instance 0481f739-3230-4857-b001-c94f5ac479e8 could not be found. Oct 24 08:50:10.537064 dv-cinder-master-3-smb devstack@n-api.service[125165]: action_args: {'id': '0481f739-3230-4857-b001-c94f5ac479e8'} Oct 24 08:50:10.537778 dv-cinder-master-3-smb devstack@n-api.service[125165]: {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:50:10.537778 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:10.537778 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:50:10.537778 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:50:10.537778 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:50:10.537778 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:50:10.537778 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:50:10.537778 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:50:10.537778 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:50:10.537778 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:50:10.537778 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0481f739-3230-4857-b001-c94f5ac479e8 could not be found. Oct 24 08:50:10.537778 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:50:10.537778 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:50:10.537778 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:50:10.537778 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:10.537778 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:50:10.537778 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:50:10.537778 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:50:10.537778 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:50:10.537778 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:50:10.539450 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:50:10.539450 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:50:10.539450 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:50:10.539450 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:50:10.539450 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:50:10.539450 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:50:10.539450 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:50:10.539450 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0481f739-3230-4857-b001-c94f5ac479e8 could not be found. Oct 24 08:50:10.539450 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:50:10.539450 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:50:10.539450 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:50:10.539450 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:50:10.539450 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:50:10.539450 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:50:10.539450 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:50:10.539450 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:50:10.539450 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0481f739-3230-4857-b001-c94f5ac479e8 could not be found. Oct 24 08:50:10.539450 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:50:10.540504 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-ed7375c8-a919-40d7-b1f2-8bce4d6458bc tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] Returning 404 to user: Instance 0481f739-3230-4857-b001-c94f5ac479e8 could not be found. {{(pid=125165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:50:10.540504 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-ed7375c8-a919-40d7-b1f2-8bce4d6458bc tempest-VolumesActionsTest-1970352770 tempest-VolumesActionsTest-1970352770-project] 10.222.0.26 "GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8" status: 404 len: 111 microversion: 2.1 time: 0.034445 Oct 24 08:50:10.540504 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 193/390] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:10 2022] GET /compute/v2.1/servers/0481f739-3230-4857-b001-c94f5ac479e8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:50:11.425607 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-ddbedaea-7b18-4098-ada3-2a4f1457d91f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:11.426200 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-ddbedaea-7b18-4098-ada3-2a4f1457d91f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f2772d7f-d505-44ab-a062-58bd88bd49d3] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:11.433072 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ddbedaea-7b18-4098-ada3-2a4f1457d91f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:11.433557 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ddbedaea-7b18-4098-ada3-2a4f1457d91f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:11.433971 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ddbedaea-7b18-4098-ada3-2a4f1457d91f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:11.434663 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ddbedaea-7b18-4098-ada3-2a4f1457d91f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:11.435149 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ddbedaea-7b18-4098-ada3-2a4f1457d91f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:11.435564 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ddbedaea-7b18-4098-ada3-2a4f1457d91f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:11.454419 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:11.574155 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-ddbedaea-7b18-4098-ada3-2a4f1457d91f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:11.585589 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-ddbedaea-7b18-4098-ada3-2a4f1457d91f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3" status: 200 len: 1510 microversion: 2.1 time: 0.163823 Oct 24 08:50:11.586242 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 198/391] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:11 2022] GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3 => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:12.609110 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-f25fe032-5793-4f0f-b1f3-9b6496eb4f9e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:12.609803 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-f25fe032-5793-4f0f-b1f3-9b6496eb4f9e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f2772d7f-d505-44ab-a062-58bd88bd49d3] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:12.615255 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_api:SELECT=88 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:12.617796 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f25fe032-5793-4f0f-b1f3-9b6496eb4f9e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:12.618368 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f25fe032-5793-4f0f-b1f3-9b6496eb4f9e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:12.619113 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f25fe032-5793-4f0f-b1f3-9b6496eb4f9e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:12.620070 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f25fe032-5793-4f0f-b1f3-9b6496eb4f9e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:12.620533 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f25fe032-5793-4f0f-b1f3-9b6496eb4f9e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:12.620950 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f25fe032-5793-4f0f-b1f3-9b6496eb4f9e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:12.761423 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-f25fe032-5793-4f0f-b1f3-9b6496eb4f9e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:12.769685 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-f25fe032-5793-4f0f-b1f3-9b6496eb4f9e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3" status: 200 len: 1510 microversion: 2.1 time: 0.164842 Oct 24 08:50:12.770253 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 194/392] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:12 2022] GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3 => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:13.799882 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-03433f92-bb4d-47ea-a427-5e8e26efeb1b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:13.800630 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-03433f92-bb4d-47ea-a427-5e8e26efeb1b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f2772d7f-d505-44ab-a062-58bd88bd49d3] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:13.828437 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-03433f92-bb4d-47ea-a427-5e8e26efeb1b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:13.829271 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-03433f92-bb4d-47ea-a427-5e8e26efeb1b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:13.829717 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-03433f92-bb4d-47ea-a427-5e8e26efeb1b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:13.830473 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-03433f92-bb4d-47ea-a427-5e8e26efeb1b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:13.830992 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-03433f92-bb4d-47ea-a427-5e8e26efeb1b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:13.831680 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-03433f92-bb4d-47ea-a427-5e8e26efeb1b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:14.315428 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-03433f92-bb4d-47ea-a427-5e8e26efeb1b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:14.325261 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-03433f92-bb4d-47ea-a427-5e8e26efeb1b tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3" status: 200 len: 1510 microversion: 2.1 time: 0.533824 Oct 24 08:50:14.334051 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 199/393] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:13 2022] GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3 => generated 1510 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:15.348838 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-7333276c-87a3-4f30-9faa-fa2e37486452 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:15.350320 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-7333276c-87a3-4f30-9faa-fa2e37486452 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f2772d7f-d505-44ab-a062-58bd88bd49d3] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:15.359339 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7333276c-87a3-4f30-9faa-fa2e37486452 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:15.360063 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7333276c-87a3-4f30-9faa-fa2e37486452 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:15.360666 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7333276c-87a3-4f30-9faa-fa2e37486452 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:15.361563 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7333276c-87a3-4f30-9faa-fa2e37486452 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:15.362351 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7333276c-87a3-4f30-9faa-fa2e37486452 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:15.362946 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7333276c-87a3-4f30-9faa-fa2e37486452 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:15.557330 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-7333276c-87a3-4f30-9faa-fa2e37486452 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:15.568139 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-7333276c-87a3-4f30-9faa-fa2e37486452 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3" status: 200 len: 1516 microversion: 2.1 time: 0.223359 Oct 24 08:50:15.568908 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 195/394] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:15 2022] GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3 => generated 1516 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:17.070576 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-cc441e75-bcf3-4315-a371-1095a2b341ed tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Action: 'create', calling method: .version_select at 0x7f7ef1778af0>, body: {"keypair": {"name": "tempest-keypair-998357312", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtZtyfa8XZt8ZDMcW8Dj/jOJwUW3F4yKC7peWjewvc6pyl2C+s5MhioeSk85Lf8lV78Wb3trwnCG04rnEKIOrs+SCjyOSstFtIMo7z7rwreA/F9W2gkyEKWpc24zOyZ6w=="}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:17.086829 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.quota [None req-cc441e75-bcf3-4315-a371-1095a2b341ed tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Getting quotas for project f063c719bcda47e6874437d32d284815. Resources: {'key_pairs'} {{(pid=125164) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:50:17.090765 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.quota [None req-cc441e75-bcf3-4315-a371-1095a2b341ed tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Getting quotas for user 8695364e58b04d829b12ae1b49757536 and project f063c719bcda47e6874437d32d284815. Resources: {'key_pairs'} {{(pid=125164) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:50:17.115695 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-cc441e75-bcf3-4315-a371-1095a2b341ed tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049105 Oct 24 08:50:17.116280 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 200/395] 10.222.0.26 () {60 vars in 1159 bytes} [Mon Oct 24 08:50:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:50:17.940823 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-7c8e1843-3efb-4568-9e1d-205c8304efe6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:17.945456 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-7c8e1843-3efb-4568-9e1d-205c8304efe6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:17.963753 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7c8e1843-3efb-4568-9e1d-205c8304efe6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:17.964472 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7c8e1843-3efb-4568-9e1d-205c8304efe6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:17.969539 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7c8e1843-3efb-4568-9e1d-205c8304efe6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:17.970483 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7c8e1843-3efb-4568-9e1d-205c8304efe6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:17.971140 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7c8e1843-3efb-4568-9e1d-205c8304efe6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:17.971730 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7c8e1843-3efb-4568-9e1d-205c8304efe6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:18.016155 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-7c8e1843-3efb-4568-9e1d-205c8304efe6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a/ips" status: 200 len: 146 microversion: 2.1 time: 0.086096 Oct 24 08:50:18.017019 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 196/396] 10.222.0.26 () {58 vars in 1248 bytes} [Mon Oct 24 08:50:17 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a/ips => generated 146 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:50:18.670024 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-f430361e-ecea-4346-a328-c1c75501f843 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1020653060", "imageRef": "7eef2d62-12dc-4746-9cbd-870797d39b4d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a81b9f60-d398-4105-9010-f91f1d9988e6"}], "security_groups": [{"name": "tempest-securitygroup--1125766013"}], "key_name": "tempest-keypair-998357312", "user_data": "}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:18.806378 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.network.neutron [None req-f430361e-ecea-4346-a328-c1c75501f843 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] validate_networks() for [('a81b9f60-d398-4105-9010-f91f1d9988e6', None, None, None, None, None)] {{(pid=125164) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:50:19.042976 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:19.385280 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-f430361e-ecea-4346-a328-c1c75501f843 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Flavor limits 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:50:19.386421 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-f430361e-ecea-4346-a328-c1c75501f843 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Image limits 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:50:19.387282 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-f430361e-ecea-4346-a328-c1c75501f843 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Flavor pref 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:50:19.388063 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-f430361e-ecea-4346-a328-c1c75501f843 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Image pref 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:50:19.388693 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-f430361e-ecea-4346-a328-c1c75501f843 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:50:19.405059 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f430361e-ecea-4346-a328-c1c75501f843 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:19.405552 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f430361e-ecea-4346-a328-c1c75501f843 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:19.406082 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f430361e-ecea-4346-a328-c1c75501f843 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:19.408651 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f430361e-ecea-4346-a328-c1c75501f843 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:19.409228 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f430361e-ecea-4346-a328-c1c75501f843 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:19.409645 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f430361e-ecea-4346-a328-c1c75501f843 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:19.463581 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.quota [None req-f430361e-ecea-4346-a328-c1c75501f843 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Getting quotas for project f063c719bcda47e6874437d32d284815. Resources: {'ram', 'cores', 'instances'} {{(pid=125164) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:50:19.471340 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.quota [None req-f430361e-ecea-4346-a328-c1c75501f843 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Getting quotas for user 8695364e58b04d829b12ae1b49757536 and project f063c719bcda47e6874437d32d284815. Resources: {'ram', 'cores', 'instances'} {{(pid=125164) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:50:19.490481 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-f430361e-ecea-4346-a328-c1c75501f843 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Going to run 1 instances... {{(pid=125164) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:50:19.493662 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-f430361e-ecea-4346-a328-c1c75501f843 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7eef2d62-12dc-4746-9cbd-870797d39b4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125164) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:50:19.551625 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-f430361e-ecea-4346-a328-c1c75501f843 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.887550 Oct 24 08:50:19.552451 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 201/397] 10.222.0.26 () {60 vars in 1147 bytes} [Mon Oct 24 08:50:18 2022] POST /compute/v2.1/servers => generated 409 bytes in 889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:50:19.564742 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-a88200d3-5192-49d3-9491-53d8a1744bfa tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:19.565339 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-a88200d3-5192-49d3-9491-53d8a1744bfa tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:19.643710 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a88200d3-5192-49d3-9491-53d8a1744bfa tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:19.651369 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-a88200d3-5192-49d3-9491-53d8a1744bfa tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1245 microversion: 2.1 time: 0.091324 Oct 24 08:50:19.652032 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 197/398] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:19 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:50:20.453243 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-fad4908c-7972-4c5d-aa6c-1f66dad14331 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "239128c7-7519-4bfc-b100-b0bcd9d46f48"}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:20.455787 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-fad4908c-7972-4c5d-aa6c-1f66dad14331 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:20.466610 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-fad4908c-7972-4c5d-aa6c-1f66dad14331 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:20.467621 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-fad4908c-7972-4c5d-aa6c-1f66dad14331 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:20.468680 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-fad4908c-7972-4c5d-aa6c-1f66dad14331 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:20.470671 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-fad4908c-7972-4c5d-aa6c-1f66dad14331 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:20.471381 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-fad4908c-7972-4c5d-aa6c-1f66dad14331 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:20.472007 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-fad4908c-7972-4c5d-aa6c-1f66dad14331 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:20.682161 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-2e43975f-8cc8-4143-a2c6-2e0cafe5f7dd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:20.683041 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-2e43975f-8cc8-4143-a2c6-2e0cafe5f7dd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:20.692217 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2e43975f-8cc8-4143-a2c6-2e0cafe5f7dd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:20.693069 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2e43975f-8cc8-4143-a2c6-2e0cafe5f7dd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:20.693940 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2e43975f-8cc8-4143-a2c6-2e0cafe5f7dd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:20.694861 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2e43975f-8cc8-4143-a2c6-2e0cafe5f7dd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:20.695382 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2e43975f-8cc8-4143-a2c6-2e0cafe5f7dd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:20.695980 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2e43975f-8cc8-4143-a2c6-2e0cafe5f7dd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:20.819111 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-2e43975f-8cc8-4143-a2c6-2e0cafe5f7dd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:20.829526 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-2e43975f-8cc8-4143-a2c6-2e0cafe5f7dd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1297 microversion: 2.1 time: 0.157261 Oct 24 08:50:20.831044 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 198/399] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:20 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1297 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:20.941255 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-fad4908c-7972-4c5d-aa6c-1f66dad14331 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "POST /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.492165 Oct 24 08:50:20.941882 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 202/400] 10.222.0.26 () {60 vars in 1323 bytes} [Mon Oct 24 08:50:20 2022] POST /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a/os-volume_attachments => generated 194 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:50:21.857281 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-0b8b9a87-a208-4418-bb71-35eb51479365 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:21.859196 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-0b8b9a87-a208-4418-bb71-35eb51479365 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:21.867705 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0b8b9a87-a208-4418-bb71-35eb51479365 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:21.868489 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0b8b9a87-a208-4418-bb71-35eb51479365 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:21.869356 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0b8b9a87-a208-4418-bb71-35eb51479365 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:21.870784 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0b8b9a87-a208-4418-bb71-35eb51479365 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:21.871587 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0b8b9a87-a208-4418-bb71-35eb51479365 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:21.872412 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0b8b9a87-a208-4418-bb71-35eb51479365 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:21.973317 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-0b8b9a87-a208-4418-bb71-35eb51479365 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:21.983862 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-0b8b9a87-a208-4418-bb71-35eb51479365 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1303 microversion: 2.1 time: 0.132807 Oct 24 08:50:21.984532 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 199/401] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:21 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1303 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:23.066507 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-3f927f40-09fb-4a74-b532-000bd89820a1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:23.072931 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-3f927f40-09fb-4a74-b532-000bd89820a1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:23.091084 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3f927f40-09fb-4a74-b532-000bd89820a1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:23.091084 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3f927f40-09fb-4a74-b532-000bd89820a1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:23.091084 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3f927f40-09fb-4a74-b532-000bd89820a1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:23.091084 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3f927f40-09fb-4a74-b532-000bd89820a1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:23.091639 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3f927f40-09fb-4a74-b532-000bd89820a1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:23.091639 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3f927f40-09fb-4a74-b532-000bd89820a1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:23.317104 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-086950f7-3f2d-43ff-9ca7-84f2fd1172e3 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:23.324073 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-086950f7-3f2d-43ff-9ca7-84f2fd1172e3 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:23.324575 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-086950f7-3f2d-43ff-9ca7-84f2fd1172e3 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:23.325196 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-086950f7-3f2d-43ff-9ca7-84f2fd1172e3 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:23.396439 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-086950f7-3f2d-43ff-9ca7-84f2fd1172e3 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Going to try to stop instance {{(pid=125165) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 24 08:50:23.473905 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-086950f7-3f2d-43ff-9ca7-84f2fd1172e3 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "POST /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a/action" status: 202 len: 0 microversion: 2.1 time: 0.161386 Oct 24 08:50:23.483862 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 200/402] 10.222.0.26 () {60 vars in 1278 bytes} [Mon Oct 24 08:50:23 2022] POST /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 08:50:23.492274 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-2c990029-5f55-4587-8a14-b3e352fdcd66 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:23.492989 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-2c990029-5f55-4587-8a14-b3e352fdcd66 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:23.511687 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2c990029-5f55-4587-8a14-b3e352fdcd66 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:23.512683 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2c990029-5f55-4587-8a14-b3e352fdcd66 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:23.515185 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2c990029-5f55-4587-8a14-b3e352fdcd66 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:23.516673 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2c990029-5f55-4587-8a14-b3e352fdcd66 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:23.519364 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2c990029-5f55-4587-8a14-b3e352fdcd66 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:23.519923 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2c990029-5f55-4587-8a14-b3e352fdcd66 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:23.660843 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-3f927f40-09fb-4a74-b532-000bd89820a1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:23.671805 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-3f927f40-09fb-4a74-b532-000bd89820a1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1371 microversion: 2.1 time: 0.663465 Oct 24 08:50:23.675579 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 203/403] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:23 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1371 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:23.814642 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-2c990029-5f55-4587-8a14-b3e352fdcd66 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:23.826455 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-2c990029-5f55-4587-8a14-b3e352fdcd66 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1725 microversion: 2.1 time: 0.338384 Oct 24 08:50:23.828416 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 201/404] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:23 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1725 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:50:24.325439 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-19b83be7-4c8b-4cbf-88b5-88389f5acd83 req-f9f79a7a-fb6d-4168-a9ed-8325dc82568d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f891147d-0b78-40f9-a17c-e1c9dbbc9f74", "tag": "d190bfd0-e1fc-4a5c-9d6c-f84bdb6d2209"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:24.335468 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-19b83be7-4c8b-4cbf-88b5-88389f5acd83 req-f9f79a7a-fb6d-4168-a9ed-8325dc82568d service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:24.335937 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-19b83be7-4c8b-4cbf-88b5-88389f5acd83 req-f9f79a7a-fb6d-4168-a9ed-8325dc82568d service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:24.336636 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-19b83be7-4c8b-4cbf-88b5-88389f5acd83 req-f9f79a7a-fb6d-4168-a9ed-8325dc82568d service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:24.347360 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-19b83be7-4c8b-4cbf-88b5-88389f5acd83 req-f9f79a7a-fb6d-4168-a9ed-8325dc82568d service nova] Creating event network-changed:d190bfd0-e1fc-4a5c-9d6c-f84bdb6d2209 for instance f891147d-0b78-40f9-a17c-e1c9dbbc9f74 on hv-cinder-maste Oct 24 08:50:24.352276 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-19b83be7-4c8b-4cbf-88b5-88389f5acd83 req-f9f79a7a-fb6d-4168-a9ed-8325dc82568d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030602 Oct 24 08:50:24.352859 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 204/405] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:50:24.700023 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-a314d584-8b6f-4def-8abe-42354d87c516 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:24.700804 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-a314d584-8b6f-4def-8abe-42354d87c516 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:24.708884 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a314d584-8b6f-4def-8abe-42354d87c516 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:24.709789 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a314d584-8b6f-4def-8abe-42354d87c516 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:24.710696 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a314d584-8b6f-4def-8abe-42354d87c516 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:24.712164 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a314d584-8b6f-4def-8abe-42354d87c516 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:24.713239 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a314d584-8b6f-4def-8abe-42354d87c516 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:24.714827 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a314d584-8b6f-4def-8abe-42354d87c516 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:24.850364 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-d99b5067-9912-4b1a-bbec-a1d7bbe4803a tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:24.851111 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-d99b5067-9912-4b1a-bbec-a1d7bbe4803a tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:24.857534 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d99b5067-9912-4b1a-bbec-a1d7bbe4803a tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:24.858101 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d99b5067-9912-4b1a-bbec-a1d7bbe4803a tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:24.858609 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d99b5067-9912-4b1a-bbec-a1d7bbe4803a tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:24.859449 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d99b5067-9912-4b1a-bbec-a1d7bbe4803a tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:24.859958 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d99b5067-9912-4b1a-bbec-a1d7bbe4803a tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:24.860440 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d99b5067-9912-4b1a-bbec-a1d7bbe4803a tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:24.973142 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a314d584-8b6f-4def-8abe-42354d87c516 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:24.983822 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-a314d584-8b6f-4def-8abe-42354d87c516 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1371 microversion: 2.1 time: 0.289081 Oct 24 08:50:24.984765 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 202/406] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:24 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1371 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:25.055323 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-d99b5067-9912-4b1a-bbec-a1d7bbe4803a tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:25.066613 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-d99b5067-9912-4b1a-bbec-a1d7bbe4803a tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1725 microversion: 2.1 time: 0.220581 Oct 24 08:50:25.068316 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 205/407] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:24 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1725 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:26.010395 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-5c4e67e5-93ed-4ee5-a184-5904d4703489 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:26.011238 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-5c4e67e5-93ed-4ee5-a184-5904d4703489 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:26.017473 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5c4e67e5-93ed-4ee5-a184-5904d4703489 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:26.018684 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5c4e67e5-93ed-4ee5-a184-5904d4703489 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:26.019385 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5c4e67e5-93ed-4ee5-a184-5904d4703489 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:26.020296 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5c4e67e5-93ed-4ee5-a184-5904d4703489 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:26.021062 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5c4e67e5-93ed-4ee5-a184-5904d4703489 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:26.021687 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5c4e67e5-93ed-4ee5-a184-5904d4703489 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:26.039731 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:26.096604 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-89b96546-5525-4ddf-b270-35de0ac4b783 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:26.097335 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-89b96546-5525-4ddf-b270-35de0ac4b783 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:26.104892 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-89b96546-5525-4ddf-b270-35de0ac4b783 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:26.105436 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-89b96546-5525-4ddf-b270-35de0ac4b783 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:26.105876 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-89b96546-5525-4ddf-b270-35de0ac4b783 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:26.106584 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-89b96546-5525-4ddf-b270-35de0ac4b783 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:26.107115 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-89b96546-5525-4ddf-b270-35de0ac4b783 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:26.107532 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-89b96546-5525-4ddf-b270-35de0ac4b783 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:26.240714 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-5c4e67e5-93ed-4ee5-a184-5904d4703489 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:26.250279 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-5c4e67e5-93ed-4ee5-a184-5904d4703489 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1371 microversion: 2.1 time: 0.244426 Oct 24 08:50:26.255017 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 203/408] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:26 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1371 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:26.329649 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-89b96546-5525-4ddf-b270-35de0ac4b783 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:26.339137 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-89b96546-5525-4ddf-b270-35de0ac4b783 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1725 microversion: 2.1 time: 0.246708 Oct 24 08:50:26.340403 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 206/409] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:26 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1725 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:27.273214 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-09cdf072-c541-4434-9549-e992794edbf8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:27.274614 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-09cdf072-c541-4434-9549-e992794edbf8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:27.281026 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-09cdf072-c541-4434-9549-e992794edbf8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:27.282240 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-09cdf072-c541-4434-9549-e992794edbf8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:27.282914 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-09cdf072-c541-4434-9549-e992794edbf8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:27.283843 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-09cdf072-c541-4434-9549-e992794edbf8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:27.284495 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-09cdf072-c541-4434-9549-e992794edbf8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:27.285399 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-09cdf072-c541-4434-9549-e992794edbf8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:27.362250 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-8c0876b0-b013-4992-9535-b99904ba0d59 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:27.363846 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-8c0876b0-b013-4992-9535-b99904ba0d59 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:27.372288 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8c0876b0-b013-4992-9535-b99904ba0d59 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:27.372786 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8c0876b0-b013-4992-9535-b99904ba0d59 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:27.373331 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8c0876b0-b013-4992-9535-b99904ba0d59 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:27.374117 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8c0876b0-b013-4992-9535-b99904ba0d59 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:27.374632 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8c0876b0-b013-4992-9535-b99904ba0d59 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:27.375154 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8c0876b0-b013-4992-9535-b99904ba0d59 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:27.462729 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-09cdf072-c541-4434-9549-e992794edbf8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:27.474069 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-09cdf072-c541-4434-9549-e992794edbf8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1371 microversion: 2.1 time: 0.202250 Oct 24 08:50:27.495232 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 204/410] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:27 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1371 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:27.557992 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-8c0876b0-b013-4992-9535-b99904ba0d59 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:27.573265 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-8c0876b0-b013-4992-9535-b99904ba0d59 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1725 microversion: 2.1 time: 0.214752 Oct 24 08:50:27.573838 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 207/411] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:27 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:50:28.521914 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-b13ff2ae-9f5d-4243-8325-8bdfb64b118f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:28.523562 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-b13ff2ae-9f5d-4243-8325-8bdfb64b118f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:28.531404 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b13ff2ae-9f5d-4243-8325-8bdfb64b118f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:28.531897 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b13ff2ae-9f5d-4243-8325-8bdfb64b118f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:28.532312 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b13ff2ae-9f5d-4243-8325-8bdfb64b118f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:28.533367 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b13ff2ae-9f5d-4243-8325-8bdfb64b118f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:28.533821 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b13ff2ae-9f5d-4243-8325-8bdfb64b118f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:28.534243 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b13ff2ae-9f5d-4243-8325-8bdfb64b118f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:28.608768 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-99b5ea7d-8b66-40ec-bd07-61425cba7aca tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:28.610108 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-99b5ea7d-8b66-40ec-bd07-61425cba7aca tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:28.623878 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-99b5ea7d-8b66-40ec-bd07-61425cba7aca tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:28.625269 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-99b5ea7d-8b66-40ec-bd07-61425cba7aca tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:28.626108 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-99b5ea7d-8b66-40ec-bd07-61425cba7aca tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:28.627864 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-99b5ea7d-8b66-40ec-bd07-61425cba7aca tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:28.628350 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-99b5ea7d-8b66-40ec-bd07-61425cba7aca tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:28.628938 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-99b5ea7d-8b66-40ec-bd07-61425cba7aca tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:28.717678 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-b13ff2ae-9f5d-4243-8325-8bdfb64b118f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:28.727453 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-b13ff2ae-9f5d-4243-8325-8bdfb64b118f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1371 microversion: 2.1 time: 0.209627 Oct 24 08:50:28.740256 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 205/412] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:28 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1371 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:28.808831 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-99b5ea7d-8b66-40ec-bd07-61425cba7aca tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:28.818143 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-99b5ea7d-8b66-40ec-bd07-61425cba7aca tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1725 microversion: 2.1 time: 0.225365 Oct 24 08:50:28.833694 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 208/413] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:28 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1725 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:50:29.753331 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-c1bc4946-9f67-4f04-a306-ce96466fc21d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:29.754816 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-c1bc4946-9f67-4f04-a306-ce96466fc21d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:29.757833 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell0:SELECT=2 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:29.761848 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c1bc4946-9f67-4f04-a306-ce96466fc21d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:29.762504 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c1bc4946-9f67-4f04-a306-ce96466fc21d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:29.763162 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c1bc4946-9f67-4f04-a306-ce96466fc21d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:29.763855 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c1bc4946-9f67-4f04-a306-ce96466fc21d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:29.764601 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c1bc4946-9f67-4f04-a306-ce96466fc21d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:29.765302 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c1bc4946-9f67-4f04-a306-ce96466fc21d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:29.838697 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell0:SELECT=2 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:29.840980 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell0:SELECT=10 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:29.846849 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-b5c394e0-a3ec-4713-b05c-df571de9f681 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:29.847747 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-b5c394e0-a3ec-4713-b05c-df571de9f681 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:29.854579 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b5c394e0-a3ec-4713-b05c-df571de9f681 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:29.855378 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b5c394e0-a3ec-4713-b05c-df571de9f681 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:29.856050 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b5c394e0-a3ec-4713-b05c-df571de9f681 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:29.857063 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b5c394e0-a3ec-4713-b05c-df571de9f681 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:29.864755 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b5c394e0-a3ec-4713-b05c-df571de9f681 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:29.865500 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b5c394e0-a3ec-4713-b05c-df571de9f681 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:29.923012 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-c1bc4946-9f67-4f04-a306-ce96466fc21d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:29.931765 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-c1bc4946-9f67-4f04-a306-ce96466fc21d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1371 microversion: 2.1 time: 0.182961 Oct 24 08:50:29.938861 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 206/414] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:29 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1371 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:30.076333 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-b5c394e0-a3ec-4713-b05c-df571de9f681 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:30.091759 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-b5c394e0-a3ec-4713-b05c-df571de9f681 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1725 microversion: 2.1 time: 0.253859 Oct 24 08:50:30.092440 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 209/415] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:29 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1725 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:30.961480 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-decfb1fb-fe06-4088-8105-9b2d4a6d7a59 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:30.963441 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-decfb1fb-fe06-4088-8105-9b2d4a6d7a59 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:30.972734 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-decfb1fb-fe06-4088-8105-9b2d4a6d7a59 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:30.974342 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-decfb1fb-fe06-4088-8105-9b2d4a6d7a59 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:30.975146 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-decfb1fb-fe06-4088-8105-9b2d4a6d7a59 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:30.976260 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-decfb1fb-fe06-4088-8105-9b2d4a6d7a59 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:30.977472 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-decfb1fb-fe06-4088-8105-9b2d4a6d7a59 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:30.978317 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-decfb1fb-fe06-4088-8105-9b2d4a6d7a59 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:31.120739 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-9ca44eeb-8f3a-4bce-8032-d2c41b8a310e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:31.123249 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-9ca44eeb-8f3a-4bce-8032-d2c41b8a310e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:31.145438 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-decfb1fb-fe06-4088-8105-9b2d4a6d7a59 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:31.156380 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-decfb1fb-fe06-4088-8105-9b2d4a6d7a59 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1371 microversion: 2.1 time: 0.200755 Oct 24 08:50:31.157033 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 207/416] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:30 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1371 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:31.164022 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9ca44eeb-8f3a-4bce-8032-d2c41b8a310e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:31.164758 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9ca44eeb-8f3a-4bce-8032-d2c41b8a310e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:31.165424 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9ca44eeb-8f3a-4bce-8032-d2c41b8a310e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:31.168463 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9ca44eeb-8f3a-4bce-8032-d2c41b8a310e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:31.175356 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9ca44eeb-8f3a-4bce-8032-d2c41b8a310e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:31.175356 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9ca44eeb-8f3a-4bce-8032-d2c41b8a310e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:31.421810 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-9ca44eeb-8f3a-4bce-8032-d2c41b8a310e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:31.430290 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-9ca44eeb-8f3a-4bce-8032-d2c41b8a310e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1725 microversion: 2.1 time: 0.314270 Oct 24 08:50:31.430890 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 210/417] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:31 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1725 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:32.185087 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-9a4c9828-7be1-4ab1-8717-1029e8a7b38e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:32.186237 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-9a4c9828-7be1-4ab1-8717-1029e8a7b38e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:32.196782 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-eaf7973d-f715-4a92-b4c1-8829eaea252a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:32.197263 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-eaf7973d-f715-4a92-b4c1-8829eaea252a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:32.201849 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9a4c9828-7be1-4ab1-8717-1029e8a7b38e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:32.202333 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9a4c9828-7be1-4ab1-8717-1029e8a7b38e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:32.202809 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9a4c9828-7be1-4ab1-8717-1029e8a7b38e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:32.206062 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-eaf7973d-f715-4a92-b4c1-8829eaea252a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:32.207031 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9a4c9828-7be1-4ab1-8717-1029e8a7b38e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:32.207698 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-eaf7973d-f715-4a92-b4c1-8829eaea252a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:32.208309 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-eaf7973d-f715-4a92-b4c1-8829eaea252a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:32.208991 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9a4c9828-7be1-4ab1-8717-1029e8a7b38e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:32.209874 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-eaf7973d-f715-4a92-b4c1-8829eaea252a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:32.210516 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9a4c9828-7be1-4ab1-8717-1029e8a7b38e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:32.215405 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-eaf7973d-f715-4a92-b4c1-8829eaea252a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:32.215846 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-eaf7973d-f715-4a92-b4c1-8829eaea252a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:32.254652 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-eaf7973d-f715-4a92-b4c1-8829eaea252a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1/ips" status: 200 len: 151 microversion: 2.1 time: 0.061730 Oct 24 08:50:32.256788 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 211/418] 10.222.0.26 () {58 vars in 1248 bytes} [Mon Oct 24 08:50:32 2022] GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1/ips => generated 151 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:50:32.393821 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-9a4c9828-7be1-4ab1-8717-1029e8a7b38e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:32.401486 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-9a4c9828-7be1-4ab1-8717-1029e8a7b38e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1371 microversion: 2.1 time: 0.220101 Oct 24 08:50:32.402288 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 208/419] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:32 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1371 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:32.453679 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-56005fd7-8bbc-45ec-8542-273e2198ed32 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:32.454305 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-56005fd7-8bbc-45ec-8542-273e2198ed32 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:32.460742 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-56005fd7-8bbc-45ec-8542-273e2198ed32 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:32.461567 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-56005fd7-8bbc-45ec-8542-273e2198ed32 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:32.462691 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-56005fd7-8bbc-45ec-8542-273e2198ed32 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:32.463731 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-56005fd7-8bbc-45ec-8542-273e2198ed32 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:32.464727 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-56005fd7-8bbc-45ec-8542-273e2198ed32 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:32.465378 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-56005fd7-8bbc-45ec-8542-273e2198ed32 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:32.687794 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-56005fd7-8bbc-45ec-8542-273e2198ed32 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:32.700745 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-56005fd7-8bbc-45ec-8542-273e2198ed32 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1725 microversion: 2.1 time: 0.250304 Oct 24 08:50:32.701818 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 212/420] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:32 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1725 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:32.822526 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-48336d0a-b912-4993-bb10-81cb1206e41a req-aefde252-2b93-4158-bc19-be8a64dd6198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f891147d-0b78-40f9-a17c-e1c9dbbc9f74", "name": "network-vif-plugged", "status": "completed", "tag": "d190bfd0-e1fc-4a5c-9d6c-f84bdb6d2209"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:32.832734 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-48336d0a-b912-4993-bb10-81cb1206e41a req-aefde252-2b93-4158-bc19-be8a64dd6198 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:32.833169 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-48336d0a-b912-4993-bb10-81cb1206e41a req-aefde252-2b93-4158-bc19-be8a64dd6198 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:32.834055 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-48336d0a-b912-4993-bb10-81cb1206e41a req-aefde252-2b93-4158-bc19-be8a64dd6198 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:32.849790 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-48336d0a-b912-4993-bb10-81cb1206e41a req-aefde252-2b93-4158-bc19-be8a64dd6198 service nova] Creating event network-vif-plugged:d190bfd0-e1fc-4a5c-9d6c-f84bdb6d2209 for instance f891147d-0b78-40f9-a17c-e1c9dbbc9f74 on hv-cinder-maste Oct 24 08:50:32.855955 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-48336d0a-b912-4993-bb10-81cb1206e41a req-aefde252-2b93-4158-bc19-be8a64dd6198 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037296 Oct 24 08:50:32.856710 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 209/421] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:50:33.424829 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-18798460-b7e7-4fac-89a9-091fc44590d6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:33.426816 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-18798460-b7e7-4fac-89a9-091fc44590d6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:33.432116 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-18798460-b7e7-4fac-89a9-091fc44590d6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:33.432533 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-18798460-b7e7-4fac-89a9-091fc44590d6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:33.432989 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-18798460-b7e7-4fac-89a9-091fc44590d6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:33.433753 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-18798460-b7e7-4fac-89a9-091fc44590d6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:33.434258 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-18798460-b7e7-4fac-89a9-091fc44590d6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:33.434700 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-18798460-b7e7-4fac-89a9-091fc44590d6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:33.568692 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-18798460-b7e7-4fac-89a9-091fc44590d6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:33.576605 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-18798460-b7e7-4fac-89a9-091fc44590d6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1371 microversion: 2.1 time: 0.155519 Oct 24 08:50:33.577064 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 213/422] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:33 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:33.727307 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-a099ffd0-5c8f-4941-9224-5278ce11c84d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:33.728220 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-a099ffd0-5c8f-4941-9224-5278ce11c84d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:33.734685 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a099ffd0-5c8f-4941-9224-5278ce11c84d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:33.735409 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a099ffd0-5c8f-4941-9224-5278ce11c84d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:33.735849 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a099ffd0-5c8f-4941-9224-5278ce11c84d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:33.736533 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a099ffd0-5c8f-4941-9224-5278ce11c84d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:33.737164 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a099ffd0-5c8f-4941-9224-5278ce11c84d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:33.737589 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a099ffd0-5c8f-4941-9224-5278ce11c84d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:33.747562 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-028d3ced-eb84-4704-bfb8-77da06fdf45c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2eaf1852-e435-4848-8e43-a496b4d5ceaa"}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:33.750165 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-028d3ced-eb84-4704-bfb8-77da06fdf45c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:33.756243 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-028d3ced-eb84-4704-bfb8-77da06fdf45c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:33.756730 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-028d3ced-eb84-4704-bfb8-77da06fdf45c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:33.757163 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-028d3ced-eb84-4704-bfb8-77da06fdf45c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:33.757851 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-028d3ced-eb84-4704-bfb8-77da06fdf45c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:33.758301 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-028d3ced-eb84-4704-bfb8-77da06fdf45c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:33.758748 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-028d3ced-eb84-4704-bfb8-77da06fdf45c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:33.879420 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a099ffd0-5c8f-4941-9224-5278ce11c84d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:33.887626 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-a099ffd0-5c8f-4941-9224-5278ce11c84d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1725 microversion: 2.1 time: 0.165469 Oct 24 08:50:33.888221 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 210/423] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:33 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:34.601348 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-57279945-e5d5-413d-a5fd-3ed37abe9376 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:34.606217 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-57279945-e5d5-413d-a5fd-3ed37abe9376 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:34.618746 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-57279945-e5d5-413d-a5fd-3ed37abe9376 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:34.619245 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-57279945-e5d5-413d-a5fd-3ed37abe9376 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:34.619683 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-57279945-e5d5-413d-a5fd-3ed37abe9376 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:34.620389 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-57279945-e5d5-413d-a5fd-3ed37abe9376 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:34.620838 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-57279945-e5d5-413d-a5fd-3ed37abe9376 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:34.621298 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-57279945-e5d5-413d-a5fd-3ed37abe9376 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:34.772941 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-57279945-e5d5-413d-a5fd-3ed37abe9376 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:34.782933 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-57279945-e5d5-413d-a5fd-3ed37abe9376 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1371 microversion: 2.1 time: 0.186936 Oct 24 08:50:34.795144 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 211/424] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:34 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:34.813929 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-028d3ced-eb84-4704-bfb8-77da06fdf45c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "POST /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.068214 Oct 24 08:50:34.814655 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 214/425] 10.222.0.26 () {60 vars in 1323 bytes} [Mon Oct 24 08:50:33 2022] POST /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1/os-volume_attachments => generated 194 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:50:34.911584 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-3df88b99-8d58-4deb-80f6-d44a2e386a06 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:34.912375 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-3df88b99-8d58-4deb-80f6-d44a2e386a06 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:34.918939 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3df88b99-8d58-4deb-80f6-d44a2e386a06 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:34.919522 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3df88b99-8d58-4deb-80f6-d44a2e386a06 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:34.919995 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3df88b99-8d58-4deb-80f6-d44a2e386a06 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:34.920848 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3df88b99-8d58-4deb-80f6-d44a2e386a06 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:34.921386 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3df88b99-8d58-4deb-80f6-d44a2e386a06 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:34.922069 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3df88b99-8d58-4deb-80f6-d44a2e386a06 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:35.095271 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-3df88b99-8d58-4deb-80f6-d44a2e386a06 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:35.104078 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-3df88b99-8d58-4deb-80f6-d44a2e386a06 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1725 microversion: 2.1 time: 0.196339 Oct 24 08:50:35.113418 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 212/426] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:34 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1725 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:35.806525 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-ab365a07-85e3-4465-a837-ab65878c7779 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:35.807268 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-ab365a07-85e3-4465-a837-ab65878c7779 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:35.813442 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ab365a07-85e3-4465-a837-ab65878c7779 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:35.813924 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ab365a07-85e3-4465-a837-ab65878c7779 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:35.814348 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ab365a07-85e3-4465-a837-ab65878c7779 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:35.815055 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ab365a07-85e3-4465-a837-ab65878c7779 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:35.815506 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ab365a07-85e3-4465-a837-ab65878c7779 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:35.815924 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ab365a07-85e3-4465-a837-ab65878c7779 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:35.820054 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:35.954381 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-ab365a07-85e3-4465-a837-ab65878c7779 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:35.962361 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-ab365a07-85e3-4465-a837-ab65878c7779 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1371 microversion: 2.1 time: 0.160632 Oct 24 08:50:35.962957 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 215/427] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:35 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:36.131030 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-dad28f87-7d1e-4ef8-a5cb-6b9e4fabb9f7 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:36.132146 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-dad28f87-7d1e-4ef8-a5cb-6b9e4fabb9f7 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:36.138091 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-dad28f87-7d1e-4ef8-a5cb-6b9e4fabb9f7 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:36.138680 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-dad28f87-7d1e-4ef8-a5cb-6b9e4fabb9f7 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:36.139238 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-dad28f87-7d1e-4ef8-a5cb-6b9e4fabb9f7 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:36.139922 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-dad28f87-7d1e-4ef8-a5cb-6b9e4fabb9f7 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:36.140371 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-dad28f87-7d1e-4ef8-a5cb-6b9e4fabb9f7 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:36.140788 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-dad28f87-7d1e-4ef8-a5cb-6b9e4fabb9f7 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:36.306148 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-dad28f87-7d1e-4ef8-a5cb-6b9e4fabb9f7 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:36.315025 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-dad28f87-7d1e-4ef8-a5cb-6b9e4fabb9f7 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1725 microversion: 2.1 time: 0.187817 Oct 24 08:50:36.315796 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 213/428] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:36 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1725 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:36.984474 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-a83b94f6-84c7-4e40-9dcc-58c97c920db4 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:36.985129 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-a83b94f6-84c7-4e40-9dcc-58c97c920db4 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:36.994364 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a83b94f6-84c7-4e40-9dcc-58c97c920db4 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:36.995105 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a83b94f6-84c7-4e40-9dcc-58c97c920db4 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:36.995673 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a83b94f6-84c7-4e40-9dcc-58c97c920db4 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:36.996496 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a83b94f6-84c7-4e40-9dcc-58c97c920db4 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:36.997102 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a83b94f6-84c7-4e40-9dcc-58c97c920db4 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:36.997537 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a83b94f6-84c7-4e40-9dcc-58c97c920db4 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:37.160444 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-a83b94f6-84c7-4e40-9dcc-58c97c920db4 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:37.170643 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-a83b94f6-84c7-4e40-9dcc-58c97c920db4 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1565 microversion: 2.1 time: 0.190112 Oct 24 08:50:37.171457 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 216/429] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:36 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1565 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:37.196195 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-c9ec57af-31c3-4b38-83e1-3720e2dae5b6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:37.196812 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-c9ec57af-31c3-4b38-83e1-3720e2dae5b6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:37.205594 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c9ec57af-31c3-4b38-83e1-3720e2dae5b6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:37.206092 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c9ec57af-31c3-4b38-83e1-3720e2dae5b6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:37.206932 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c9ec57af-31c3-4b38-83e1-3720e2dae5b6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:37.207643 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c9ec57af-31c3-4b38-83e1-3720e2dae5b6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:37.208259 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c9ec57af-31c3-4b38-83e1-3720e2dae5b6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:37.208692 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c9ec57af-31c3-4b38-83e1-3720e2dae5b6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:37.329993 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-c9ec57af-31c3-4b38-83e1-3720e2dae5b6 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.139974 Oct 24 08:50:37.330815 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 214/430] 10.222.0.26 () {58 vars in 1275 bytes} [Mon Oct 24 08:50:37 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74/os-interface => generated 284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:50:37.341900 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-62637da2-9c37-4bf7-b606-dc3d5debb396 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:37.342669 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-62637da2-9c37-4bf7-b606-dc3d5debb396 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:37.349569 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-62637da2-9c37-4bf7-b606-dc3d5debb396 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:37.350197 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-62637da2-9c37-4bf7-b606-dc3d5debb396 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:37.350705 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-62637da2-9c37-4bf7-b606-dc3d5debb396 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:37.351835 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-62637da2-9c37-4bf7-b606-dc3d5debb396 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:37.352474 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-62637da2-9c37-4bf7-b606-dc3d5debb396 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:37.352963 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-62637da2-9c37-4bf7-b606-dc3d5debb396 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:37.573584 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-62637da2-9c37-4bf7-b606-dc3d5debb396 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:37.583662 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-62637da2-9c37-4bf7-b606-dc3d5debb396 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1725 microversion: 2.1 time: 0.245987 Oct 24 08:50:37.584156 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 217/431] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:37 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1725 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:38.170923 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-040228d4-ac29-471e-b89d-431d1c008624 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Action: 'create', calling method: .version_select at 0x7f7ef1728c10>, body: {"keypair": {"name": "tempest-keypair-26474901", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL74My2ia/0tB0eBWdzMOEny1yQI93MkvwptRBw2GmF/mN9/xghxyRa00ydu8noTjbGY8sdNhgCauBY7kVFgMZhJ0A7XRj5dynBWQJZyK5Ly55ebn9rCVZEdbr3Cxgyc/g=="}} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:38.187238 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.quota [None req-040228d4-ac29-471e-b89d-431d1c008624 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Getting quotas for project 02be1b30677f400788b35b03938e44e5. Resources: {'key_pairs'} {{(pid=125165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:50:38.197177 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.quota [None req-040228d4-ac29-471e-b89d-431d1c008624 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Getting quotas for user 712e5cf4cc004918817ab1802b9c69d6 and project 02be1b30677f400788b35b03938e44e5. Resources: {'key_pairs'} {{(pid=125165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:50:38.225113 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-040228d4-ac29-471e-b89d-431d1c008624 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.058395 Oct 24 08:50:38.231447 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 215/432] 10.222.0.26 () {60 vars in 1159 bytes} [Mon Oct 24 08:50:38 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:50:38.474842 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-03181fda-7233-4229-9b0e-a8ebe9294cba req-0319dcda-2021-4bc3-bff1-1f3708a4aa24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f891147d-0b78-40f9-a17c-e1c9dbbc9f74", "tag": "d190bfd0-e1fc-4a5c-9d6c-f84bdb6d2209"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:38.490566 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-03181fda-7233-4229-9b0e-a8ebe9294cba req-0319dcda-2021-4bc3-bff1-1f3708a4aa24 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:38.491410 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-03181fda-7233-4229-9b0e-a8ebe9294cba req-0319dcda-2021-4bc3-bff1-1f3708a4aa24 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:38.491825 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-03181fda-7233-4229-9b0e-a8ebe9294cba req-0319dcda-2021-4bc3-bff1-1f3708a4aa24 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:38.507747 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-03181fda-7233-4229-9b0e-a8ebe9294cba req-0319dcda-2021-4bc3-bff1-1f3708a4aa24 service nova] Creating event network-changed:d190bfd0-e1fc-4a5c-9d6c-f84bdb6d2209 for instance f891147d-0b78-40f9-a17c-e1c9dbbc9f74 on hv-cinder-maste Oct 24 08:50:38.513538 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-03181fda-7233-4229-9b0e-a8ebe9294cba req-0319dcda-2021-4bc3-bff1-1f3708a4aa24 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042266 Oct 24 08:50:38.514562 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 218/433] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:50:38.630477 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-78c4a170-e676-45d9-8063-433b40974641 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:38.632300 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-78c4a170-e676-45d9-8063-433b40974641 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:38.656074 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-78c4a170-e676-45d9-8063-433b40974641 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:38.657393 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-78c4a170-e676-45d9-8063-433b40974641 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:38.664818 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-78c4a170-e676-45d9-8063-433b40974641 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:38.669007 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-78c4a170-e676-45d9-8063-433b40974641 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:38.669007 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-78c4a170-e676-45d9-8063-433b40974641 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:38.669007 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-78c4a170-e676-45d9-8063-433b40974641 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:39.007999 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-78c4a170-e676-45d9-8063-433b40974641 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:39.019782 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-78c4a170-e676-45d9-8063-433b40974641 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1725 microversion: 2.1 time: 0.403447 Oct 24 08:50:39.028103 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 216/434] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:38 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1725 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:40.045905 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-f053ab7b-ad59-4a69-8e64-9a8466a5eed6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:40.050277 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-f053ab7b-ad59-4a69-8e64-9a8466a5eed6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:40.060918 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f053ab7b-ad59-4a69-8e64-9a8466a5eed6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:40.061418 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f053ab7b-ad59-4a69-8e64-9a8466a5eed6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:40.064340 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f053ab7b-ad59-4a69-8e64-9a8466a5eed6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:40.066875 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f053ab7b-ad59-4a69-8e64-9a8466a5eed6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:40.067542 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f053ab7b-ad59-4a69-8e64-9a8466a5eed6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:40.068128 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f053ab7b-ad59-4a69-8e64-9a8466a5eed6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:40.322392 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-f053ab7b-ad59-4a69-8e64-9a8466a5eed6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:40.337642 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-f053ab7b-ad59-4a69-8e64-9a8466a5eed6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1702 microversion: 2.1 time: 0.297466 Oct 24 08:50:40.339121 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 219/435] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:40 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1702 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:40.361325 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-b3b8200c-816a-4f42-bde3-d90f49c99ace tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:40.367536 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b3b8200c-816a-4f42-bde3-d90f49c99ace tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:40.368054 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b3b8200c-816a-4f42-bde3-d90f49c99ace tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:40.368485 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b3b8200c-816a-4f42-bde3-d90f49c99ace tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:40.394059 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-b3b8200c-816a-4f42-bde3-d90f49c99ace tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Going to try to start instance {{(pid=125165) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 24 08:50:40.410292 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-fb0a8432-d64d-4a35-b5ea-4ee5476f99c1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1524945027", "imageRef": "7eef2d62-12dc-4746-9cbd-870797d39b4d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "af0d0daa-6faa-4e0a-a58b-da03c7bc2818"}], "security_groups": [{"name": "tempest-securitygroup--821785395"}], "key_name": "tempest-keypair-26474901", "user_data": "}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:40.441127 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-b3b8200c-816a-4f42-bde3-d90f49c99ace tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "POST /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a/action" status: 202 len: 0 microversion: 2.1 time: 0.083642 Oct 24 08:50:40.442085 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 217/436] 10.222.0.26 () {60 vars in 1278 bytes} [Mon Oct 24 08:50:40 2022] POST /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:50:40.454284 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-04f3aa43-6a02-4df6-b305-363c10ca2ef4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:40.455419 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-04f3aa43-6a02-4df6-b305-363c10ca2ef4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:40.467987 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-04f3aa43-6a02-4df6-b305-363c10ca2ef4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:40.468839 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-04f3aa43-6a02-4df6-b305-363c10ca2ef4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:40.469362 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-04f3aa43-6a02-4df6-b305-363c10ca2ef4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:40.470262 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-04f3aa43-6a02-4df6-b305-363c10ca2ef4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:40.470956 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-04f3aa43-6a02-4df6-b305-363c10ca2ef4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:40.471589 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-04f3aa43-6a02-4df6-b305-363c10ca2ef4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:40.587608 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.network.neutron [None req-fb0a8432-d64d-4a35-b5ea-4ee5476f99c1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] validate_networks() for [('af0d0daa-6faa-4e0a-a58b-da03c7bc2818', None, None, None, None, None)] {{(pid=125164) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:50:40.793896 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-04f3aa43-6a02-4df6-b305-363c10ca2ef4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:40.803166 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-04f3aa43-6a02-4df6-b305-363c10ca2ef4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1711 microversion: 2.1 time: 0.355901 Oct 24 08:50:40.803930 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 218/437] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:40 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1711 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:50:41.523817 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-fb0a8432-d64d-4a35-b5ea-4ee5476f99c1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Flavor limits 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:50:41.524312 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-fb0a8432-d64d-4a35-b5ea-4ee5476f99c1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Image limits 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:50:41.524668 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-fb0a8432-d64d-4a35-b5ea-4ee5476f99c1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Flavor pref 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:50:41.525317 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-fb0a8432-d64d-4a35-b5ea-4ee5476f99c1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Image pref 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:50:41.525698 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-fb0a8432-d64d-4a35-b5ea-4ee5476f99c1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:50:41.535358 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-fb0a8432-d64d-4a35-b5ea-4ee5476f99c1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:41.535849 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-fb0a8432-d64d-4a35-b5ea-4ee5476f99c1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:41.536281 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-fb0a8432-d64d-4a35-b5ea-4ee5476f99c1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:41.537011 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-fb0a8432-d64d-4a35-b5ea-4ee5476f99c1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:41.537472 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-fb0a8432-d64d-4a35-b5ea-4ee5476f99c1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:41.537900 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-fb0a8432-d64d-4a35-b5ea-4ee5476f99c1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:41.557143 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.quota [None req-fb0a8432-d64d-4a35-b5ea-4ee5476f99c1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Getting quotas for project 02be1b30677f400788b35b03938e44e5. Resources: {'ram', 'cores', 'instances'} {{(pid=125164) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:50:41.563262 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.quota [None req-fb0a8432-d64d-4a35-b5ea-4ee5476f99c1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Getting quotas for user 712e5cf4cc004918817ab1802b9c69d6 and project 02be1b30677f400788b35b03938e44e5. Resources: {'ram', 'cores', 'instances'} {{(pid=125164) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:50:41.574299 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-fb0a8432-d64d-4a35-b5ea-4ee5476f99c1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Going to run 1 instances... {{(pid=125164) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:50:41.576729 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-fb0a8432-d64d-4a35-b5ea-4ee5476f99c1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 880d7b45-efa0-4aec-9342-b84795db3c74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7eef2d62-12dc-4746-9cbd-870797d39b4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125164) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:50:41.625748 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-fb0a8432-d64d-4a35-b5ea-4ee5476f99c1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.219880 Oct 24 08:50:41.627075 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 220/438] 10.222.0.26 () {60 vars in 1147 bytes} [Mon Oct 24 08:50:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 1222 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:50:41.637685 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-a2e36d17-4acf-4cae-a7d8-7a974f1a7ff2 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:41.638244 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-a2e36d17-4acf-4cae-a7d8-7a974f1a7ff2 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 880d7b45-efa0-4aec-9342-b84795db3c74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:41.701310 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a2e36d17-4acf-4cae-a7d8-7a974f1a7ff2 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:41.710855 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-a2e36d17-4acf-4cae-a7d8-7a974f1a7ff2 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74" status: 200 len: 1240 microversion: 2.1 time: 0.076972 Oct 24 08:50:41.711508 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 219/439] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:41 2022] GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74 => generated 1240 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:41.830481 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-4df013d0-b4ae-4c2a-bf76-43ab4677b941 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:41.831232 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-4df013d0-b4ae-4c2a-bf76-43ab4677b941 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:41.838425 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4df013d0-b4ae-4c2a-bf76-43ab4677b941 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:41.838968 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4df013d0-b4ae-4c2a-bf76-43ab4677b941 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:41.839403 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4df013d0-b4ae-4c2a-bf76-43ab4677b941 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:41.840124 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4df013d0-b4ae-4c2a-bf76-43ab4677b941 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:41.840576 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4df013d0-b4ae-4c2a-bf76-43ab4677b941 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:41.841023 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4df013d0-b4ae-4c2a-bf76-43ab4677b941 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:41.980034 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-4df013d0-b4ae-4c2a-bf76-43ab4677b941 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:41.989764 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-4df013d0-b4ae-4c2a-bf76-43ab4677b941 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1711 microversion: 2.1 time: 0.163295 Oct 24 08:50:41.990581 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 221/440] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:41 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1711 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:42.598701 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-2b4fe281-54d2-49f1-b70c-5a32047dc0bf tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:42.599201 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-2b4fe281-54d2-49f1-b70c-5a32047dc0bf tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:42.606314 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2b4fe281-54d2-49f1-b70c-5a32047dc0bf tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:42.606844 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2b4fe281-54d2-49f1-b70c-5a32047dc0bf tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:42.607406 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2b4fe281-54d2-49f1-b70c-5a32047dc0bf tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:42.608097 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2b4fe281-54d2-49f1-b70c-5a32047dc0bf tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:42.608548 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2b4fe281-54d2-49f1-b70c-5a32047dc0bf tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:42.609007 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2b4fe281-54d2-49f1-b70c-5a32047dc0bf tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:42.633889 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-2b4fe281-54d2-49f1-b70c-5a32047dc0bf tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e/ips" status: 200 len: 152 microversion: 2.20 time: 0.039350 Oct 24 08:50:42.634425 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 220/441] 10.222.0.26 () {60 vars in 1289 bytes} [Mon Oct 24 08:50:42 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:50:42.734425 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-b6a23abf-94fb-49a8-91cb-1c346837eb03 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:42.735220 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-b6a23abf-94fb-49a8-91cb-1c346837eb03 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 880d7b45-efa0-4aec-9342-b84795db3c74] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:42.741567 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b6a23abf-94fb-49a8-91cb-1c346837eb03 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:42.742228 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b6a23abf-94fb-49a8-91cb-1c346837eb03 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:42.742981 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b6a23abf-94fb-49a8-91cb-1c346837eb03 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:42.743636 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b6a23abf-94fb-49a8-91cb-1c346837eb03 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:42.744254 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b6a23abf-94fb-49a8-91cb-1c346837eb03 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:42.744883 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b6a23abf-94fb-49a8-91cb-1c346837eb03 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:42.816864 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-b6a23abf-94fb-49a8-91cb-1c346837eb03 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:42.825757 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-b6a23abf-94fb-49a8-91cb-1c346837eb03 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74" status: 200 len: 1292 microversion: 2.1 time: 0.095953 Oct 24 08:50:42.834266 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 222/442] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:42 2022] GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74 => generated 1292 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:43.013163 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-6d847a2c-55ac-4bce-97d6-41c696a94c0e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:43.013845 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-6d847a2c-55ac-4bce-97d6-41c696a94c0e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:43.016033 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:43.022234 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6d847a2c-55ac-4bce-97d6-41c696a94c0e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:43.022748 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6d847a2c-55ac-4bce-97d6-41c696a94c0e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:43.023210 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6d847a2c-55ac-4bce-97d6-41c696a94c0e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:43.023904 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6d847a2c-55ac-4bce-97d6-41c696a94c0e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:43.024355 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6d847a2c-55ac-4bce-97d6-41c696a94c0e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:43.024772 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6d847a2c-55ac-4bce-97d6-41c696a94c0e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:43.162873 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-6d847a2c-55ac-4bce-97d6-41c696a94c0e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:43.173252 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-6d847a2c-55ac-4bce-97d6-41c696a94c0e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1711 microversion: 2.1 time: 0.164048 Oct 24 08:50:43.173785 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 221/443] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:43 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1711 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:43.848179 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-3fe23470-d8cd-4cff-a69c-ad039391d28f tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:43.848901 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-3fe23470-d8cd-4cff-a69c-ad039391d28f tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 880d7b45-efa0-4aec-9342-b84795db3c74] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:43.856522 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3fe23470-d8cd-4cff-a69c-ad039391d28f tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:43.857073 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3fe23470-d8cd-4cff-a69c-ad039391d28f tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:43.857650 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3fe23470-d8cd-4cff-a69c-ad039391d28f tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:43.858570 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3fe23470-d8cd-4cff-a69c-ad039391d28f tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:43.859060 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3fe23470-d8cd-4cff-a69c-ad039391d28f tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:43.859567 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3fe23470-d8cd-4cff-a69c-ad039391d28f tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:43.925858 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-3fe23470-d8cd-4cff-a69c-ad039391d28f tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:43.933759 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-3fe23470-d8cd-4cff-a69c-ad039391d28f tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74" status: 200 len: 1292 microversion: 2.1 time: 0.089578 Oct 24 08:50:43.934352 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 223/444] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:43 2022] GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74 => generated 1292 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:44.198061 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-1913c91b-703e-4e83-99f4-02fb41595348 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:44.199602 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-1913c91b-703e-4e83-99f4-02fb41595348 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:44.206108 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1913c91b-703e-4e83-99f4-02fb41595348 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:44.206596 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1913c91b-703e-4e83-99f4-02fb41595348 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:44.207064 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1913c91b-703e-4e83-99f4-02fb41595348 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:44.207754 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1913c91b-703e-4e83-99f4-02fb41595348 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:44.208527 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1913c91b-703e-4e83-99f4-02fb41595348 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:44.208949 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1913c91b-703e-4e83-99f4-02fb41595348 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:44.226568 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:44.407862 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-1913c91b-703e-4e83-99f4-02fb41595348 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:44.416246 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-1913c91b-703e-4e83-99f4-02fb41595348 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1715 microversion: 2.1 time: 0.222686 Oct 24 08:50:44.417364 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 222/445] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:44 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1715 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:44.708924 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-c009099b-4f55-4fe4-90c0-f847e6b7a231 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:44.709251 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-c009099b-4f55-4fe4-90c0-f847e6b7a231 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:44.717002 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c009099b-4f55-4fe4-90c0-f847e6b7a231 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:44.717893 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c009099b-4f55-4fe4-90c0-f847e6b7a231 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:44.718544 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c009099b-4f55-4fe4-90c0-f847e6b7a231 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:44.719561 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c009099b-4f55-4fe4-90c0-f847e6b7a231 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:44.720153 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c009099b-4f55-4fe4-90c0-f847e6b7a231 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:44.720785 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c009099b-4f55-4fe4-90c0-f847e6b7a231 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:44.746853 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.objects.instance [None req-c009099b-4f55-4fe4-90c0-f847e6b7a231 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lazy-loading 'flavor' on Instance uuid cf8e51c6-99cf-49c6-b25b-89c3c7045e4e {{(pid=125164) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:50:44.957172 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-ef8406f9-e991-4f35-a8aa-4a2377ceae46 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:44.957784 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-ef8406f9-e991-4f35-a8aa-4a2377ceae46 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 880d7b45-efa0-4aec-9342-b84795db3c74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:44.965758 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ef8406f9-e991-4f35-a8aa-4a2377ceae46 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:44.966657 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ef8406f9-e991-4f35-a8aa-4a2377ceae46 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:44.967338 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ef8406f9-e991-4f35-a8aa-4a2377ceae46 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:44.968275 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ef8406f9-e991-4f35-a8aa-4a2377ceae46 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:44.969278 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ef8406f9-e991-4f35-a8aa-4a2377ceae46 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:44.969901 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ef8406f9-e991-4f35-a8aa-4a2377ceae46 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:44.999101 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-c009099b-4f55-4fe4-90c0-f847e6b7a231 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "POST /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e/action" status: 202 len: 0 microversion: 2.20 time: 0.293984 Oct 24 08:50:45.000800 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 224/446] 10.222.0.26 () {62 vars in 1319 bytes} [Mon Oct 24 08:50:44 2022] POST /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:50:45.011796 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-b22d76f7-e5ba-4add-820a-f02b0ddc793c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:45.012747 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-b22d76f7-e5ba-4add-820a-f02b0ddc793c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:45.019774 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b22d76f7-e5ba-4add-820a-f02b0ddc793c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:45.020246 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b22d76f7-e5ba-4add-820a-f02b0ddc793c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:45.020870 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b22d76f7-e5ba-4add-820a-f02b0ddc793c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:45.021556 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b22d76f7-e5ba-4add-820a-f02b0ddc793c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:45.022026 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b22d76f7-e5ba-4add-820a-f02b0ddc793c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:45.022450 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b22d76f7-e5ba-4add-820a-f02b0ddc793c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:45.320890 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-ef8406f9-e991-4f35-a8aa-4a2377ceae46 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:45.329701 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-ef8406f9-e991-4f35-a8aa-4a2377ceae46 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74" status: 200 len: 1365 microversion: 2.1 time: 0.376799 Oct 24 08:50:45.331035 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 223/447] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:44 2022] GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74 => generated 1365 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:50:45.381604 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-b22d76f7-e5ba-4add-820a-f02b0ddc793c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:45.394411 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-b22d76f7-e5ba-4add-820a-f02b0ddc793c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:45.395970 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-b22d76f7-e5ba-4add-820a-f02b0ddc793c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:45.397543 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-b22d76f7-e5ba-4add-820a-f02b0ddc793c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1723 microversion: 2.20 time: 0.391587 Oct 24 08:50:45.398348 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 225/448] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:50:45 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1723 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:50:46.169966 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-09bcae42-a751-4b3e-9a8a-ca08ace70509 req-8461b398-9613-409d-b1d6-fc45397e93d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "880d7b45-efa0-4aec-9342-b84795db3c74", "tag": "1b98709b-e1ec-4e41-be52-911e7f2f8294"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:46.179666 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-09bcae42-a751-4b3e-9a8a-ca08ace70509 req-8461b398-9613-409d-b1d6-fc45397e93d7 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:46.180135 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-09bcae42-a751-4b3e-9a8a-ca08ace70509 req-8461b398-9613-409d-b1d6-fc45397e93d7 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:46.181396 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-09bcae42-a751-4b3e-9a8a-ca08ace70509 req-8461b398-9613-409d-b1d6-fc45397e93d7 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:46.196295 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-09bcae42-a751-4b3e-9a8a-ca08ace70509 req-8461b398-9613-409d-b1d6-fc45397e93d7 service nova] Creating event network-changed:1b98709b-e1ec-4e41-be52-911e7f2f8294 for instance 880d7b45-efa0-4aec-9342-b84795db3c74 on hv-cinder-maste Oct 24 08:50:46.202179 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-09bcae42-a751-4b3e-9a8a-ca08ace70509 req-8461b398-9613-409d-b1d6-fc45397e93d7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037121 Oct 24 08:50:46.203058 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 224/449] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:50:46.353566 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-130192ac-e725-4ae5-a48b-f171b8ec244c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:46.354153 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-130192ac-e725-4ae5-a48b-f171b8ec244c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 880d7b45-efa0-4aec-9342-b84795db3c74] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:46.360906 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-130192ac-e725-4ae5-a48b-f171b8ec244c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:46.361388 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-130192ac-e725-4ae5-a48b-f171b8ec244c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:46.361818 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-130192ac-e725-4ae5-a48b-f171b8ec244c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:46.362482 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-130192ac-e725-4ae5-a48b-f171b8ec244c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:46.362983 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-130192ac-e725-4ae5-a48b-f171b8ec244c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:46.363389 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-130192ac-e725-4ae5-a48b-f171b8ec244c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:46.427713 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-5dee602c-1987-4592-8026-779a14f4737a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:46.428406 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-5dee602c-1987-4592-8026-779a14f4737a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:46.434963 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5dee602c-1987-4592-8026-779a14f4737a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:46.435451 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5dee602c-1987-4592-8026-779a14f4737a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:46.435882 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5dee602c-1987-4592-8026-779a14f4737a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:46.436571 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5dee602c-1987-4592-8026-779a14f4737a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:46.437015 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5dee602c-1987-4592-8026-779a14f4737a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:46.437436 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5dee602c-1987-4592-8026-779a14f4737a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:46.637595 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-130192ac-e725-4ae5-a48b-f171b8ec244c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:46.645597 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-130192ac-e725-4ae5-a48b-f171b8ec244c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74" status: 200 len: 1365 microversion: 2.1 time: 0.295903 Oct 24 08:50:46.646398 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 226/450] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:46 2022] GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74 => generated 1365 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:46.686205 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-5dee602c-1987-4592-8026-779a14f4737a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:46.694505 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-5dee602c-1987-4592-8026-779a14f4737a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:46.695986 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-5dee602c-1987-4592-8026-779a14f4737a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:46.697142 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-5dee602c-1987-4592-8026-779a14f4737a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1723 microversion: 2.20 time: 0.273848 Oct 24 08:50:46.697688 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 225/451] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:50:46 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1723 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:50:47.669239 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-255aa43c-006c-454f-be18-67d7c5500ecb tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:47.669812 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-255aa43c-006c-454f-be18-67d7c5500ecb tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 880d7b45-efa0-4aec-9342-b84795db3c74] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:47.676921 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-255aa43c-006c-454f-be18-67d7c5500ecb tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:47.677409 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-255aa43c-006c-454f-be18-67d7c5500ecb tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:47.677839 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-255aa43c-006c-454f-be18-67d7c5500ecb tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:47.678523 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-255aa43c-006c-454f-be18-67d7c5500ecb tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:47.679008 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-255aa43c-006c-454f-be18-67d7c5500ecb tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:47.679426 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-255aa43c-006c-454f-be18-67d7c5500ecb tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:47.723470 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-b4e6e726-1360-4be7-9b9a-1625cc01e5aa tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:47.724002 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-b4e6e726-1360-4be7-9b9a-1625cc01e5aa tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:47.730230 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b4e6e726-1360-4be7-9b9a-1625cc01e5aa tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:47.730702 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b4e6e726-1360-4be7-9b9a-1625cc01e5aa tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:47.731156 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b4e6e726-1360-4be7-9b9a-1625cc01e5aa tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:47.732900 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b4e6e726-1360-4be7-9b9a-1625cc01e5aa tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:47.733681 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b4e6e726-1360-4be7-9b9a-1625cc01e5aa tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:47.734086 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b4e6e726-1360-4be7-9b9a-1625cc01e5aa tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:47.878441 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-255aa43c-006c-454f-be18-67d7c5500ecb tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:47.887454 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-255aa43c-006c-454f-be18-67d7c5500ecb tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74" status: 200 len: 1365 microversion: 2.1 time: 0.222440 Oct 24 08:50:47.888048 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 227/452] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:47 2022] GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74 => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:47.908081 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-b4e6e726-1360-4be7-9b9a-1625cc01e5aa tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:47.916496 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-b4e6e726-1360-4be7-9b9a-1625cc01e5aa tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:47.918259 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-b4e6e726-1360-4be7-9b9a-1625cc01e5aa tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:47.919436 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-b4e6e726-1360-4be7-9b9a-1625cc01e5aa tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1723 microversion: 2.20 time: 0.200541 Oct 24 08:50:47.919982 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 226/453] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:50:47 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:50:48.911880 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-3917dbda-bf3f-44f4-bbce-0babf17f0bed tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:48.912751 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-3917dbda-bf3f-44f4-bbce-0babf17f0bed tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 880d7b45-efa0-4aec-9342-b84795db3c74] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:48.920943 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3917dbda-bf3f-44f4-bbce-0babf17f0bed tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:48.921490 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3917dbda-bf3f-44f4-bbce-0babf17f0bed tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:48.921974 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3917dbda-bf3f-44f4-bbce-0babf17f0bed tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:48.922793 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3917dbda-bf3f-44f4-bbce-0babf17f0bed tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:48.923405 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3917dbda-bf3f-44f4-bbce-0babf17f0bed tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:48.923871 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3917dbda-bf3f-44f4-bbce-0babf17f0bed tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:48.944953 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-0de06d57-ff62-4657-be9b-865b298c304c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:48.945642 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-0de06d57-ff62-4657-be9b-865b298c304c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:48.951898 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0de06d57-ff62-4657-be9b-865b298c304c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:48.952559 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0de06d57-ff62-4657-be9b-865b298c304c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:48.953067 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0de06d57-ff62-4657-be9b-865b298c304c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:48.953833 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0de06d57-ff62-4657-be9b-865b298c304c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:48.954466 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0de06d57-ff62-4657-be9b-865b298c304c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:48.954989 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0de06d57-ff62-4657-be9b-865b298c304c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:49.118372 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-3917dbda-bf3f-44f4-bbce-0babf17f0bed tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:49.126196 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-3917dbda-bf3f-44f4-bbce-0babf17f0bed tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74" status: 200 len: 1365 microversion: 2.1 time: 0.218983 Oct 24 08:50:49.126670 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-0de06d57-ff62-4657-be9b-865b298c304c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:49.126837 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 228/454] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:48 2022] GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74 => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:49.134930 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-0de06d57-ff62-4657-be9b-865b298c304c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:49.136367 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-0de06d57-ff62-4657-be9b-865b298c304c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:49.137519 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-0de06d57-ff62-4657-be9b-865b298c304c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1723 microversion: 2.20 time: 0.196561 Oct 24 08:50:49.138058 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 227/455] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:50:48 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:50:50.149123 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-b6b6ae69-c8df-4481-bba7-047889f870e8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:50.149751 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-b6b6ae69-c8df-4481-bba7-047889f870e8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 880d7b45-efa0-4aec-9342-b84795db3c74] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:50.152177 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:50.157283 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b6b6ae69-c8df-4481-bba7-047889f870e8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:50.159301 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b6b6ae69-c8df-4481-bba7-047889f870e8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:50.159301 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b6b6ae69-c8df-4481-bba7-047889f870e8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:50.160558 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b6b6ae69-c8df-4481-bba7-047889f870e8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:50.161032 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b6b6ae69-c8df-4481-bba7-047889f870e8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:50.161450 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b6b6ae69-c8df-4481-bba7-047889f870e8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:50.163853 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-96ccf7f1-9375-4fc5-b67a-0bd4d423a8d1 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:50.164715 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-96ccf7f1-9375-4fc5-b67a-0bd4d423a8d1 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:50.171324 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-96ccf7f1-9375-4fc5-b67a-0bd4d423a8d1 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:50.172096 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-96ccf7f1-9375-4fc5-b67a-0bd4d423a8d1 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:50.172871 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-96ccf7f1-9375-4fc5-b67a-0bd4d423a8d1 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:50.173934 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-96ccf7f1-9375-4fc5-b67a-0bd4d423a8d1 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:50.174533 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-96ccf7f1-9375-4fc5-b67a-0bd4d423a8d1 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:50.175000 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-96ccf7f1-9375-4fc5-b67a-0bd4d423a8d1 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:50.673843 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-b6b6ae69-c8df-4481-bba7-047889f870e8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:50.677061 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-96ccf7f1-9375-4fc5-b67a-0bd4d423a8d1 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:50.686592 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-b6b6ae69-c8df-4481-bba7-047889f870e8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74" status: 200 len: 1365 microversion: 2.1 time: 0.541286 Oct 24 08:50:50.687320 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 229/456] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:50 2022] GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74 => generated 1365 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:50:50.696452 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-96ccf7f1-9375-4fc5-b67a-0bd4d423a8d1 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:50.697978 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-96ccf7f1-9375-4fc5-b67a-0bd4d423a8d1 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:50.699994 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-96ccf7f1-9375-4fc5-b67a-0bd4d423a8d1 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1723 microversion: 2.20 time: 0.540409 Oct 24 08:50:50.701057 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 228/457] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:50:50 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1723 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:50:51.709962 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-343f8845-0476-48c5-bc09-7dbc60761d68 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:51.710549 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-343f8845-0476-48c5-bc09-7dbc60761d68 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 880d7b45-efa0-4aec-9342-b84795db3c74] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:51.712933 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell0:SELECT=2 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:51.713600 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell0:SELECT=6 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:51.719704 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-343f8845-0476-48c5-bc09-7dbc60761d68 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:51.720194 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-343f8845-0476-48c5-bc09-7dbc60761d68 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:51.720635 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-343f8845-0476-48c5-bc09-7dbc60761d68 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:51.721325 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-343f8845-0476-48c5-bc09-7dbc60761d68 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:51.721841 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-343f8845-0476-48c5-bc09-7dbc60761d68 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:51.722266 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-343f8845-0476-48c5-bc09-7dbc60761d68 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:51.727630 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-bd69fe31-dbf6-44e4-b281-b1c7ad33e90b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:51.727630 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-bd69fe31-dbf6-44e4-b281-b1c7ad33e90b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:51.729140 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell0:SELECT=6 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:51.733934 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bd69fe31-dbf6-44e4-b281-b1c7ad33e90b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:51.734422 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bd69fe31-dbf6-44e4-b281-b1c7ad33e90b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:51.734902 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bd69fe31-dbf6-44e4-b281-b1c7ad33e90b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:51.735591 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bd69fe31-dbf6-44e4-b281-b1c7ad33e90b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:51.736039 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bd69fe31-dbf6-44e4-b281-b1c7ad33e90b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:51.736460 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bd69fe31-dbf6-44e4-b281-b1c7ad33e90b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:51.918525 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-343f8845-0476-48c5-bc09-7dbc60761d68 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:51.926743 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-343f8845-0476-48c5-bc09-7dbc60761d68 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74" status: 200 len: 1365 microversion: 2.1 time: 0.220888 Oct 24 08:50:51.927325 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 230/458] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:51 2022] GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74 => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:51.932432 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-bd69fe31-dbf6-44e4-b281-b1c7ad33e90b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:51.940859 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-bd69fe31-dbf6-44e4-b281-b1c7ad33e90b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:51.942248 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-bd69fe31-dbf6-44e4-b281-b1c7ad33e90b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:51.943467 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-bd69fe31-dbf6-44e4-b281-b1c7ad33e90b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1723 microversion: 2.20 time: 0.221096 Oct 24 08:50:51.944009 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 229/459] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:50:51 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:50:52.950421 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-e54f7562-965b-43cf-84d3-ff964fb7a8a9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:52.951018 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-e54f7562-965b-43cf-84d3-ff964fb7a8a9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 880d7b45-efa0-4aec-9342-b84795db3c74] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:52.957436 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e54f7562-965b-43cf-84d3-ff964fb7a8a9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:52.957919 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e54f7562-965b-43cf-84d3-ff964fb7a8a9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:52.958351 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e54f7562-965b-43cf-84d3-ff964fb7a8a9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:52.959067 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e54f7562-965b-43cf-84d3-ff964fb7a8a9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:52.959522 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e54f7562-965b-43cf-84d3-ff964fb7a8a9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:52.959946 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e54f7562-965b-43cf-84d3-ff964fb7a8a9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:52.964990 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:52.969835 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-cdca2194-017f-4568-9d2b-9dafc287a750 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:52.970514 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-cdca2194-017f-4568-9d2b-9dafc287a750 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:52.976919 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cdca2194-017f-4568-9d2b-9dafc287a750 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:52.977471 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cdca2194-017f-4568-9d2b-9dafc287a750 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:52.977916 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cdca2194-017f-4568-9d2b-9dafc287a750 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:52.978830 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cdca2194-017f-4568-9d2b-9dafc287a750 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:52.979465 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cdca2194-017f-4568-9d2b-9dafc287a750 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:52.980196 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cdca2194-017f-4568-9d2b-9dafc287a750 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:53.148646 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-e54f7562-965b-43cf-84d3-ff964fb7a8a9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:53.157232 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-e54f7562-965b-43cf-84d3-ff964fb7a8a9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74" status: 200 len: 1365 microversion: 2.1 time: 0.211057 Oct 24 08:50:53.157807 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 231/460] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:52 2022] GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74 => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:53.162289 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-bae5dd82-7b2c-44c7-8b70-e7eee017c2e1 req-8e86f99c-a083-4bb1-9aba-0fa73b27ccb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "880d7b45-efa0-4aec-9342-b84795db3c74", "name": "network-vif-plugged", "status": "completed", "tag": "1b98709b-e1ec-4e41-be52-911e7f2f8294"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:53.172049 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-bae5dd82-7b2c-44c7-8b70-e7eee017c2e1 req-8e86f99c-a083-4bb1-9aba-0fa73b27ccb1 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:53.172449 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-cdca2194-017f-4568-9d2b-9dafc287a750 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:53.172594 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-bae5dd82-7b2c-44c7-8b70-e7eee017c2e1 req-8e86f99c-a083-4bb1-9aba-0fa73b27ccb1 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:53.172946 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-bae5dd82-7b2c-44c7-8b70-e7eee017c2e1 req-8e86f99c-a083-4bb1-9aba-0fa73b27ccb1 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:53.180686 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-cdca2194-017f-4568-9d2b-9dafc287a750 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:53.182137 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-cdca2194-017f-4568-9d2b-9dafc287a750 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:53.183310 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-cdca2194-017f-4568-9d2b-9dafc287a750 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1723 microversion: 2.20 time: 0.218631 Oct 24 08:50:53.183831 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 230/461] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:50:52 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:50:53.184268 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-bae5dd82-7b2c-44c7-8b70-e7eee017c2e1 req-8e86f99c-a083-4bb1-9aba-0fa73b27ccb1 service nova] Creating event network-vif-plugged:1b98709b-e1ec-4e41-be52-911e7f2f8294 for instance 880d7b45-efa0-4aec-9342-b84795db3c74 on hv-cinder-maste Oct 24 08:50:53.189513 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-bae5dd82-7b2c-44c7-8b70-e7eee017c2e1 req-8e86f99c-a083-4bb1-9aba-0fa73b27ccb1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030641 Oct 24 08:50:53.190142 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 232/462] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:50:54.185038 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-f3bb747b-3870-416c-9e7f-2cc87191f0f9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:54.186163 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-f3bb747b-3870-416c-9e7f-2cc87191f0f9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 880d7b45-efa0-4aec-9342-b84795db3c74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:54.196865 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f3bb747b-3870-416c-9e7f-2cc87191f0f9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:54.197680 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f3bb747b-3870-416c-9e7f-2cc87191f0f9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:54.198421 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f3bb747b-3870-416c-9e7f-2cc87191f0f9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:54.199632 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f3bb747b-3870-416c-9e7f-2cc87191f0f9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:54.200383 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f3bb747b-3870-416c-9e7f-2cc87191f0f9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:54.201091 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f3bb747b-3870-416c-9e7f-2cc87191f0f9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:54.210771 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-9748beaf-cdbb-4378-8ab1-871cdc310c34 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:54.211488 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-9748beaf-cdbb-4378-8ab1-871cdc310c34 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:54.217872 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9748beaf-cdbb-4378-8ab1-871cdc310c34 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:54.218351 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9748beaf-cdbb-4378-8ab1-871cdc310c34 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:54.218774 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9748beaf-cdbb-4378-8ab1-871cdc310c34 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:54.219488 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9748beaf-cdbb-4378-8ab1-871cdc310c34 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:54.219932 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9748beaf-cdbb-4378-8ab1-871cdc310c34 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:54.220347 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9748beaf-cdbb-4378-8ab1-871cdc310c34 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:54.399138 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-f3bb747b-3870-416c-9e7f-2cc87191f0f9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:54.402560 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-9748beaf-cdbb-4378-8ab1-871cdc310c34 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:54.406996 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-f3bb747b-3870-416c-9e7f-2cc87191f0f9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74" status: 200 len: 1365 microversion: 2.1 time: 0.228527 Oct 24 08:50:54.407572 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 231/463] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:54 2022] GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74 => generated 1365 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:54.410635 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-9748beaf-cdbb-4378-8ab1-871cdc310c34 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:54.412101 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-9748beaf-cdbb-4378-8ab1-871cdc310c34 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:54.413267 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-9748beaf-cdbb-4378-8ab1-871cdc310c34 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1723 microversion: 2.20 time: 0.207623 Oct 24 08:50:54.413844 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 233/464] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:50:54 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:50:55.434557 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-d4ef7c91-563d-406a-a9bc-e4eb005b13c9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:55.435712 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-d4ef7c91-563d-406a-a9bc-e4eb005b13c9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 880d7b45-efa0-4aec-9342-b84795db3c74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:55.441631 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-010e5f1d-0c91-43a0-beaf-9dc179c8d71b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:55.442269 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-010e5f1d-0c91-43a0-beaf-9dc179c8d71b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:55.443651 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d4ef7c91-563d-406a-a9bc-e4eb005b13c9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:55.444133 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d4ef7c91-563d-406a-a9bc-e4eb005b13c9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:55.445003 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d4ef7c91-563d-406a-a9bc-e4eb005b13c9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:55.445693 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d4ef7c91-563d-406a-a9bc-e4eb005b13c9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:55.446145 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d4ef7c91-563d-406a-a9bc-e4eb005b13c9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:55.446558 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d4ef7c91-563d-406a-a9bc-e4eb005b13c9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:55.448888 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-010e5f1d-0c91-43a0-beaf-9dc179c8d71b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:55.449380 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-010e5f1d-0c91-43a0-beaf-9dc179c8d71b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:55.449802 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-010e5f1d-0c91-43a0-beaf-9dc179c8d71b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:55.450489 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-010e5f1d-0c91-43a0-beaf-9dc179c8d71b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:55.450971 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-010e5f1d-0c91-43a0-beaf-9dc179c8d71b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:55.451390 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-010e5f1d-0c91-43a0-beaf-9dc179c8d71b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:55.648913 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-d4ef7c91-563d-406a-a9bc-e4eb005b13c9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:55.651907 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-010e5f1d-0c91-43a0-beaf-9dc179c8d71b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:55.657120 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-d4ef7c91-563d-406a-a9bc-e4eb005b13c9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74" status: 200 len: 1365 microversion: 2.1 time: 0.229170 Oct 24 08:50:55.657720 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 232/465] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:55 2022] GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74 => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:55.660527 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-010e5f1d-0c91-43a0-beaf-9dc179c8d71b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:55.661931 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-010e5f1d-0c91-43a0-beaf-9dc179c8d71b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:55.663213 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-010e5f1d-0c91-43a0-beaf-9dc179c8d71b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1723 microversion: 2.20 time: 0.227498 Oct 24 08:50:55.663756 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 234/466] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:50:55 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:50:56.680116 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-4eb20b85-ccca-40d2-a604-aec23a7ed677 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:56.680709 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-4eb20b85-ccca-40d2-a604-aec23a7ed677 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 880d7b45-efa0-4aec-9342-b84795db3c74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:56.686964 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4eb20b85-ccca-40d2-a604-aec23a7ed677 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:56.687446 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4eb20b85-ccca-40d2-a604-aec23a7ed677 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:56.687877 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4eb20b85-ccca-40d2-a604-aec23a7ed677 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:56.688565 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4eb20b85-ccca-40d2-a604-aec23a7ed677 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:56.688712 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-4d7db04d-cd1d-441f-9741-11f4a1693fd8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:56.689128 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4eb20b85-ccca-40d2-a604-aec23a7ed677 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:56.689217 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-4d7db04d-cd1d-441f-9741-11f4a1693fd8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:56.689398 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4eb20b85-ccca-40d2-a604-aec23a7ed677 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:56.696475 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4d7db04d-cd1d-441f-9741-11f4a1693fd8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:56.696947 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4d7db04d-cd1d-441f-9741-11f4a1693fd8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:56.697391 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4d7db04d-cd1d-441f-9741-11f4a1693fd8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:56.698072 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4d7db04d-cd1d-441f-9741-11f4a1693fd8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:56.698519 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4d7db04d-cd1d-441f-9741-11f4a1693fd8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:56.698953 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4d7db04d-cd1d-441f-9741-11f4a1693fd8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:56.882563 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-4eb20b85-ccca-40d2-a604-aec23a7ed677 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:56.885771 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-4d7db04d-cd1d-441f-9741-11f4a1693fd8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:56.890766 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-4eb20b85-ccca-40d2-a604-aec23a7ed677 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74" status: 200 len: 1555 microversion: 2.1 time: 0.214476 Oct 24 08:50:56.891354 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 233/467] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:50:56 2022] GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74 => generated 1555 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:50:56.894002 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-4d7db04d-cd1d-441f-9741-11f4a1693fd8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:56.895487 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-4d7db04d-cd1d-441f-9741-11f4a1693fd8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:56.896635 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-4d7db04d-cd1d-441f-9741-11f4a1693fd8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1723 microversion: 2.20 time: 0.212116 Oct 24 08:50:56.898757 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 235/468] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:50:56 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:50:56.913317 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-42b52335-39cd-4f4f-94c8-282034c1a6ea tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:56.913930 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-42b52335-39cd-4f4f-94c8-282034c1a6ea tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 880d7b45-efa0-4aec-9342-b84795db3c74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:56.921567 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-42b52335-39cd-4f4f-94c8-282034c1a6ea tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:56.922048 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-42b52335-39cd-4f4f-94c8-282034c1a6ea tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:56.922480 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-42b52335-39cd-4f4f-94c8-282034c1a6ea tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:56.923197 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-42b52335-39cd-4f4f-94c8-282034c1a6ea tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:56.923651 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-42b52335-39cd-4f4f-94c8-282034c1a6ea tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:56.924067 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-42b52335-39cd-4f4f-94c8-282034c1a6ea tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:57.001477 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-42b52335-39cd-4f4f-94c8-282034c1a6ea tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092035 Oct 24 08:50:57.002087 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 234/469] 10.222.0.26 () {58 vars in 1275 bytes} [Mon Oct 24 08:50:56 2022] GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:50:57.922628 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-293353dc-4a89-4ad9-80cc-b3a246ad3444 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:57.923221 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-293353dc-4a89-4ad9-80cc-b3a246ad3444 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:57.930065 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-293353dc-4a89-4ad9-80cc-b3a246ad3444 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:57.930775 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-293353dc-4a89-4ad9-80cc-b3a246ad3444 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:57.931448 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-293353dc-4a89-4ad9-80cc-b3a246ad3444 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:57.932326 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-293353dc-4a89-4ad9-80cc-b3a246ad3444 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:57.932829 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-293353dc-4a89-4ad9-80cc-b3a246ad3444 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:57.933429 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-293353dc-4a89-4ad9-80cc-b3a246ad3444 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:57.951293 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-ec069d64-b599-4496-89d2-db8ca9dd22c8 req-1d39ae9b-3068-4728-bfaa-1457d6e5059c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "880d7b45-efa0-4aec-9342-b84795db3c74", "tag": "1b98709b-e1ec-4e41-be52-911e7f2f8294"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:50:57.961542 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-ec069d64-b599-4496-89d2-db8ca9dd22c8 req-1d39ae9b-3068-4728-bfaa-1457d6e5059c service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:57.962025 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-ec069d64-b599-4496-89d2-db8ca9dd22c8 req-1d39ae9b-3068-4728-bfaa-1457d6e5059c service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:57.962464 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-ec069d64-b599-4496-89d2-db8ca9dd22c8 req-1d39ae9b-3068-4728-bfaa-1457d6e5059c service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:57.974145 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-ec069d64-b599-4496-89d2-db8ca9dd22c8 req-1d39ae9b-3068-4728-bfaa-1457d6e5059c service nova] Creating event network-changed:1b98709b-e1ec-4e41-be52-911e7f2f8294 for instance 880d7b45-efa0-4aec-9342-b84795db3c74 on hv-cinder-maste Oct 24 08:50:57.979684 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-ec069d64-b599-4496-89d2-db8ca9dd22c8 req-1d39ae9b-3068-4728-bfaa-1457d6e5059c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032033 Oct 24 08:50:57.980376 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 235/470] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:50:58.103525 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-293353dc-4a89-4ad9-80cc-b3a246ad3444 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:58.112167 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-293353dc-4a89-4ad9-80cc-b3a246ad3444 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:58.113803 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-293353dc-4a89-4ad9-80cc-b3a246ad3444 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:58.116209 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-293353dc-4a89-4ad9-80cc-b3a246ad3444 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1723 microversion: 2.20 time: 0.198125 Oct 24 08:50:58.117047 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 236/471] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:50:57 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:50:59.142854 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-b92dfb0c-f9a7-46b0-bf93-e1fb22216d17 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:50:59.143538 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-b92dfb0c-f9a7-46b0-bf93-e1fb22216d17 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:50:59.150077 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b92dfb0c-f9a7-46b0-bf93-e1fb22216d17 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:59.150555 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b92dfb0c-f9a7-46b0-bf93-e1fb22216d17 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:59.151013 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b92dfb0c-f9a7-46b0-bf93-e1fb22216d17 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:59.151695 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b92dfb0c-f9a7-46b0-bf93-e1fb22216d17 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:50:59.152135 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b92dfb0c-f9a7-46b0-bf93-e1fb22216d17 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:50:59.152551 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b92dfb0c-f9a7-46b0-bf93-e1fb22216d17 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:50:59.297227 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-b92dfb0c-f9a7-46b0-bf93-e1fb22216d17 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:59.305660 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-b92dfb0c-f9a7-46b0-bf93-e1fb22216d17 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:59.307111 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-b92dfb0c-f9a7-46b0-bf93-e1fb22216d17 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:50:59.308260 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-b92dfb0c-f9a7-46b0-bf93-e1fb22216d17 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1723 microversion: 2.20 time: 0.169766 Oct 24 08:50:59.308817 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 236/472] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:50:59 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:00.333541 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-2920fe4e-aaec-43da-a70e-a68d69a9b897 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:00.334145 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-2920fe4e-aaec-43da-a70e-a68d69a9b897 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:00.340750 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2920fe4e-aaec-43da-a70e-a68d69a9b897 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:00.341269 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2920fe4e-aaec-43da-a70e-a68d69a9b897 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:00.341656 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2920fe4e-aaec-43da-a70e-a68d69a9b897 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:00.342347 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2920fe4e-aaec-43da-a70e-a68d69a9b897 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:00.342835 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2920fe4e-aaec-43da-a70e-a68d69a9b897 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:00.343255 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2920fe4e-aaec-43da-a70e-a68d69a9b897 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:00.478963 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-2920fe4e-aaec-43da-a70e-a68d69a9b897 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:00.487209 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-2920fe4e-aaec-43da-a70e-a68d69a9b897 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:00.488887 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-2920fe4e-aaec-43da-a70e-a68d69a9b897 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:00.494918 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-2920fe4e-aaec-43da-a70e-a68d69a9b897 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1723 microversion: 2.20 time: 0.160531 Oct 24 08:51:00.494918 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 237/473] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:00 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:01.521277 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-632d7dfd-8bb7-49e8-90d1-b2889c908941 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:01.522261 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-632d7dfd-8bb7-49e8-90d1-b2889c908941 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:01.529624 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-632d7dfd-8bb7-49e8-90d1-b2889c908941 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:01.530106 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-632d7dfd-8bb7-49e8-90d1-b2889c908941 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:01.530530 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-632d7dfd-8bb7-49e8-90d1-b2889c908941 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:01.531239 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-632d7dfd-8bb7-49e8-90d1-b2889c908941 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:01.531696 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-632d7dfd-8bb7-49e8-90d1-b2889c908941 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:01.532102 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-632d7dfd-8bb7-49e8-90d1-b2889c908941 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:01.677074 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-632d7dfd-8bb7-49e8-90d1-b2889c908941 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:01.692778 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-632d7dfd-8bb7-49e8-90d1-b2889c908941 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:01.700076 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-632d7dfd-8bb7-49e8-90d1-b2889c908941 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:01.704699 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-632d7dfd-8bb7-49e8-90d1-b2889c908941 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1723 microversion: 2.20 time: 0.189964 Oct 24 08:51:01.705260 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 237/474] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:01 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:02.732963 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-9f568d51-fa3c-4047-91ac-f2dfac9690ac tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:02.733697 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-9f568d51-fa3c-4047-91ac-f2dfac9690ac tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:02.742461 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9f568d51-fa3c-4047-91ac-f2dfac9690ac tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:02.743151 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9f568d51-fa3c-4047-91ac-f2dfac9690ac tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:02.743685 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9f568d51-fa3c-4047-91ac-f2dfac9690ac tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:02.744540 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9f568d51-fa3c-4047-91ac-f2dfac9690ac tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:02.745096 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9f568d51-fa3c-4047-91ac-f2dfac9690ac tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:02.745617 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9f568d51-fa3c-4047-91ac-f2dfac9690ac tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:02.883788 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-9f568d51-fa3c-4047-91ac-f2dfac9690ac tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:02.892212 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-9f568d51-fa3c-4047-91ac-f2dfac9690ac tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:02.893715 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-9f568d51-fa3c-4047-91ac-f2dfac9690ac tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:02.894952 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-9f568d51-fa3c-4047-91ac-f2dfac9690ac tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1744 microversion: 2.20 time: 0.167094 Oct 24 08:51:02.895512 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 238/475] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:02 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1744 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:03.921581 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-9d605452-5db2-49f7-9f26-386a2d15bbec tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:03.922210 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-9d605452-5db2-49f7-9f26-386a2d15bbec tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:03.928673 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9d605452-5db2-49f7-9f26-386a2d15bbec tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:03.929168 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9d605452-5db2-49f7-9f26-386a2d15bbec tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:03.929614 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9d605452-5db2-49f7-9f26-386a2d15bbec tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:03.930303 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9d605452-5db2-49f7-9f26-386a2d15bbec tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:03.930757 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9d605452-5db2-49f7-9f26-386a2d15bbec tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:03.931276 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9d605452-5db2-49f7-9f26-386a2d15bbec tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:04.061025 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-9d605452-5db2-49f7-9f26-386a2d15bbec tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:04.069324 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-9d605452-5db2-49f7-9f26-386a2d15bbec tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:04.070780 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-9d605452-5db2-49f7-9f26-386a2d15bbec tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:04.071950 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-9d605452-5db2-49f7-9f26-386a2d15bbec tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1744 microversion: 2.20 time: 0.154900 Oct 24 08:51:04.072533 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 238/476] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:03 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:05.097728 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-18d7a829-19cb-4727-837b-350bad700478 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:05.098377 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-18d7a829-19cb-4727-837b-350bad700478 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:05.105811 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-18d7a829-19cb-4727-837b-350bad700478 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:05.106374 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-18d7a829-19cb-4727-837b-350bad700478 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:05.106924 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-18d7a829-19cb-4727-837b-350bad700478 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:05.108243 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-18d7a829-19cb-4727-837b-350bad700478 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:05.108699 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-18d7a829-19cb-4727-837b-350bad700478 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:05.109132 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-18d7a829-19cb-4727-837b-350bad700478 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:05.241981 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-18d7a829-19cb-4727-837b-350bad700478 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:05.250633 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-18d7a829-19cb-4727-837b-350bad700478 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:05.252104 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-18d7a829-19cb-4727-837b-350bad700478 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:05.253281 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-18d7a829-19cb-4727-837b-350bad700478 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1744 microversion: 2.20 time: 0.159651 Oct 24 08:51:05.253841 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 239/477] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:05 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:51:06.279229 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-a7088737-be2e-46b0-9814-3987c98f9bf9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:06.279847 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-a7088737-be2e-46b0-9814-3987c98f9bf9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:06.286321 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a7088737-be2e-46b0-9814-3987c98f9bf9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:06.286857 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a7088737-be2e-46b0-9814-3987c98f9bf9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:06.287294 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a7088737-be2e-46b0-9814-3987c98f9bf9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:06.287998 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a7088737-be2e-46b0-9814-3987c98f9bf9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:06.288447 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a7088737-be2e-46b0-9814-3987c98f9bf9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:06.288875 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a7088737-be2e-46b0-9814-3987c98f9bf9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:06.429067 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a7088737-be2e-46b0-9814-3987c98f9bf9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:06.437701 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a7088737-be2e-46b0-9814-3987c98f9bf9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:06.439193 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a7088737-be2e-46b0-9814-3987c98f9bf9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:06.440357 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-a7088737-be2e-46b0-9814-3987c98f9bf9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1744 microversion: 2.20 time: 0.165312 Oct 24 08:51:06.440931 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 239/478] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:06 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:07.036356 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-eee0548a-64a0-42aa-8b08-0e8de26d0f51 req-de24f95e-9faa-4ce3-af26-fbda6ff2dd6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf8e51c6-99cf-49c6-b25b-89c3c7045e4e", "name": "network-vif-plugged", "status": "completed", "tag": "c7a98c12-528e-4bbb-9ae8-1c8aaf7fbba9"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:07.046540 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-eee0548a-64a0-42aa-8b08-0e8de26d0f51 req-de24f95e-9faa-4ce3-af26-fbda6ff2dd6a service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:07.047044 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-eee0548a-64a0-42aa-8b08-0e8de26d0f51 req-de24f95e-9faa-4ce3-af26-fbda6ff2dd6a service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:07.047468 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-eee0548a-64a0-42aa-8b08-0e8de26d0f51 req-de24f95e-9faa-4ce3-af26-fbda6ff2dd6a service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:07.060930 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-eee0548a-64a0-42aa-8b08-0e8de26d0f51 req-de24f95e-9faa-4ce3-af26-fbda6ff2dd6a service nova] Creating event network-vif-plugged:c7a98c12-528e-4bbb-9ae8-1c8aaf7fbba9 for instance cf8e51c6-99cf-49c6-b25b-89c3c7045e4e on hv-cinder-maste Oct 24 08:51:07.066050 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-eee0548a-64a0-42aa-8b08-0e8de26d0f51 req-de24f95e-9faa-4ce3-af26-fbda6ff2dd6a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033518 Oct 24 08:51:07.066751 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 240/479] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:07.465436 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-91fa182b-8e16-46d5-acb2-cc50abd879bc tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:07.466028 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-91fa182b-8e16-46d5-acb2-cc50abd879bc tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:07.472416 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-91fa182b-8e16-46d5-acb2-cc50abd879bc tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:07.472887 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-91fa182b-8e16-46d5-acb2-cc50abd879bc tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:07.473339 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-91fa182b-8e16-46d5-acb2-cc50abd879bc tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:07.474034 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-91fa182b-8e16-46d5-acb2-cc50abd879bc tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:07.474480 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-91fa182b-8e16-46d5-acb2-cc50abd879bc tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:07.474928 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-91fa182b-8e16-46d5-acb2-cc50abd879bc tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:07.609423 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-91fa182b-8e16-46d5-acb2-cc50abd879bc tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:07.611720 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell1:SELECT=100 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:07.619188 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-91fa182b-8e16-46d5-acb2-cc50abd879bc tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:07.620605 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-91fa182b-8e16-46d5-acb2-cc50abd879bc tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:07.621793 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-91fa182b-8e16-46d5-acb2-cc50abd879bc tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1744 microversion: 2.20 time: 0.160286 Oct 24 08:51:07.622583 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 240/480] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:07 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:08.653290 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-8b7d6e9d-963c-4fb1-8f12-45a5fe9a2a68 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:08.654425 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-8b7d6e9d-963c-4fb1-8f12-45a5fe9a2a68 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:08.664957 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8b7d6e9d-963c-4fb1-8f12-45a5fe9a2a68 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:08.665764 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8b7d6e9d-963c-4fb1-8f12-45a5fe9a2a68 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:08.666492 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8b7d6e9d-963c-4fb1-8f12-45a5fe9a2a68 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:08.668267 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8b7d6e9d-963c-4fb1-8f12-45a5fe9a2a68 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:08.669027 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8b7d6e9d-963c-4fb1-8f12-45a5fe9a2a68 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:08.669687 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8b7d6e9d-963c-4fb1-8f12-45a5fe9a2a68 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:08.801831 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-8b7d6e9d-963c-4fb1-8f12-45a5fe9a2a68 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:08.810371 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-8b7d6e9d-963c-4fb1-8f12-45a5fe9a2a68 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:08.811845 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-8b7d6e9d-963c-4fb1-8f12-45a5fe9a2a68 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:08.813015 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-8b7d6e9d-963c-4fb1-8f12-45a5fe9a2a68 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1744 microversion: 2.20 time: 0.167631 Oct 24 08:51:08.813576 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 241/481] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:08 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1744 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:09.841670 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-a4b5d351-2983-4871-8a70-fc6fa87a6821 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:09.842466 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-a4b5d351-2983-4871-8a70-fc6fa87a6821 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:09.849182 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a4b5d351-2983-4871-8a70-fc6fa87a6821 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:09.849668 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a4b5d351-2983-4871-8a70-fc6fa87a6821 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:09.850104 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a4b5d351-2983-4871-8a70-fc6fa87a6821 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:09.850812 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a4b5d351-2983-4871-8a70-fc6fa87a6821 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:09.851270 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a4b5d351-2983-4871-8a70-fc6fa87a6821 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:09.851689 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a4b5d351-2983-4871-8a70-fc6fa87a6821 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:09.990734 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a4b5d351-2983-4871-8a70-fc6fa87a6821 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:09.998896 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a4b5d351-2983-4871-8a70-fc6fa87a6821 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:10.000559 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a4b5d351-2983-4871-8a70-fc6fa87a6821 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:10.001701 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-a4b5d351-2983-4871-8a70-fc6fa87a6821 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1739 microversion: 2.20 time: 0.166615 Oct 24 08:51:10.002244 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 241/482] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:09 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:11.028306 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-96cac59c-6958-485e-8c79-20f34eb622b7 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:11.028924 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-96cac59c-6958-485e-8c79-20f34eb622b7 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:11.036879 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-96cac59c-6958-485e-8c79-20f34eb622b7 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:11.037743 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-96cac59c-6958-485e-8c79-20f34eb622b7 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:11.038569 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-96cac59c-6958-485e-8c79-20f34eb622b7 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:11.039792 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-96cac59c-6958-485e-8c79-20f34eb622b7 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:11.040418 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-96cac59c-6958-485e-8c79-20f34eb622b7 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:11.041322 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-96cac59c-6958-485e-8c79-20f34eb622b7 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:11.201867 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-96cac59c-6958-485e-8c79-20f34eb622b7 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:11.211581 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-96cac59c-6958-485e-8c79-20f34eb622b7 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:11.213297 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-96cac59c-6958-485e-8c79-20f34eb622b7 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:11.214634 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-96cac59c-6958-485e-8c79-20f34eb622b7 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1739 microversion: 2.20 time: 0.190506 Oct 24 08:51:11.215229 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 242/483] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:11 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:12.240621 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-23ad8f98-19f7-4bce-b9d3-1f866c5eef66 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:12.241383 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-23ad8f98-19f7-4bce-b9d3-1f866c5eef66 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:12.247995 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-23ad8f98-19f7-4bce-b9d3-1f866c5eef66 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:12.248581 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-23ad8f98-19f7-4bce-b9d3-1f866c5eef66 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:12.249017 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-23ad8f98-19f7-4bce-b9d3-1f866c5eef66 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:12.249707 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-23ad8f98-19f7-4bce-b9d3-1f866c5eef66 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:12.250156 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-23ad8f98-19f7-4bce-b9d3-1f866c5eef66 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:12.250576 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-23ad8f98-19f7-4bce-b9d3-1f866c5eef66 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:12.397761 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-23ad8f98-19f7-4bce-b9d3-1f866c5eef66 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:12.406284 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-23ad8f98-19f7-4bce-b9d3-1f866c5eef66 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:12.407733 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-23ad8f98-19f7-4bce-b9d3-1f866c5eef66 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:12.409019 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-23ad8f98-19f7-4bce-b9d3-1f866c5eef66 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1739 microversion: 2.20 time: 0.173043 Oct 24 08:51:12.409726 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 242/484] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:12 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:51:13.437650 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-5fcac7da-5b76-488f-a8b3-5c2e5dc7e589 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:13.439040 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-5fcac7da-5b76-488f-a8b3-5c2e5dc7e589 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:13.449223 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5fcac7da-5b76-488f-a8b3-5c2e5dc7e589 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:13.449742 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5fcac7da-5b76-488f-a8b3-5c2e5dc7e589 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:13.450199 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5fcac7da-5b76-488f-a8b3-5c2e5dc7e589 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:13.450914 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5fcac7da-5b76-488f-a8b3-5c2e5dc7e589 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:13.451375 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5fcac7da-5b76-488f-a8b3-5c2e5dc7e589 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:13.451783 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5fcac7da-5b76-488f-a8b3-5c2e5dc7e589 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:13.593947 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-5fcac7da-5b76-488f-a8b3-5c2e5dc7e589 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:13.602597 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-5fcac7da-5b76-488f-a8b3-5c2e5dc7e589 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:13.604381 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-5fcac7da-5b76-488f-a8b3-5c2e5dc7e589 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:13.605617 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-5fcac7da-5b76-488f-a8b3-5c2e5dc7e589 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1739 microversion: 2.20 time: 0.172019 Oct 24 08:51:13.606246 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 243/485] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:13 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:14.631336 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-6954919d-b421-4b77-bce8-5b8e34de1652 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:14.632864 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-6954919d-b421-4b77-bce8-5b8e34de1652 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:14.638589 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_api:SELECT=44 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:14.640953 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6954919d-b421-4b77-bce8-5b8e34de1652 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:14.641529 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6954919d-b421-4b77-bce8-5b8e34de1652 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:14.642063 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6954919d-b421-4b77-bce8-5b8e34de1652 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:14.642874 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6954919d-b421-4b77-bce8-5b8e34de1652 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:14.643407 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6954919d-b421-4b77-bce8-5b8e34de1652 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:14.643890 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6954919d-b421-4b77-bce8-5b8e34de1652 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:14.785722 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-6954919d-b421-4b77-bce8-5b8e34de1652 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:14.796506 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-6954919d-b421-4b77-bce8-5b8e34de1652 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:14.797958 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-6954919d-b421-4b77-bce8-5b8e34de1652 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:14.799178 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-6954919d-b421-4b77-bce8-5b8e34de1652 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1739 microversion: 2.20 time: 0.172052 Oct 24 08:51:14.799751 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 243/486] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:14 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:15.824023 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-81d91f5b-8169-4f22-be1c-c123d679cd85 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:15.825429 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-81d91f5b-8169-4f22-be1c-c123d679cd85 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:15.832411 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-81d91f5b-8169-4f22-be1c-c123d679cd85 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:15.833318 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-81d91f5b-8169-4f22-be1c-c123d679cd85 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:15.833767 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-81d91f5b-8169-4f22-be1c-c123d679cd85 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:15.834698 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-81d91f5b-8169-4f22-be1c-c123d679cd85 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:15.835523 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-81d91f5b-8169-4f22-be1c-c123d679cd85 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:15.836735 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-81d91f5b-8169-4f22-be1c-c123d679cd85 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:15.990160 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-81d91f5b-8169-4f22-be1c-c123d679cd85 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:15.999746 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-81d91f5b-8169-4f22-be1c-c123d679cd85 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:16.001193 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-81d91f5b-8169-4f22-be1c-c123d679cd85 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:16.002436 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-81d91f5b-8169-4f22-be1c-c123d679cd85 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1739 microversion: 2.20 time: 0.182556 Oct 24 08:51:16.003062 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 244/487] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:15 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:17.028096 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-b28daa3c-6a0c-47db-8dee-e75ea29aa92f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:17.028671 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-b28daa3c-6a0c-47db-8dee-e75ea29aa92f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:17.035463 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b28daa3c-6a0c-47db-8dee-e75ea29aa92f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:17.035940 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b28daa3c-6a0c-47db-8dee-e75ea29aa92f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:17.036602 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b28daa3c-6a0c-47db-8dee-e75ea29aa92f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:17.037315 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b28daa3c-6a0c-47db-8dee-e75ea29aa92f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:17.037824 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b28daa3c-6a0c-47db-8dee-e75ea29aa92f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:17.038247 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b28daa3c-6a0c-47db-8dee-e75ea29aa92f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:17.205085 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-b28daa3c-6a0c-47db-8dee-e75ea29aa92f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:17.213495 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-b28daa3c-6a0c-47db-8dee-e75ea29aa92f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:17.215669 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-b28daa3c-6a0c-47db-8dee-e75ea29aa92f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:17.217079 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-b28daa3c-6a0c-47db-8dee-e75ea29aa92f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1739 microversion: 2.20 time: 0.193020 Oct 24 08:51:17.217800 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 244/488] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:17 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:18.244068 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-0d9b2ff3-c450-4f42-b87a-5379493eeea8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:18.244679 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-0d9b2ff3-c450-4f42-b87a-5379493eeea8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:18.254773 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0d9b2ff3-c450-4f42-b87a-5379493eeea8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:18.255579 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0d9b2ff3-c450-4f42-b87a-5379493eeea8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:18.256288 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0d9b2ff3-c450-4f42-b87a-5379493eeea8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:18.256993 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0d9b2ff3-c450-4f42-b87a-5379493eeea8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:18.257428 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0d9b2ff3-c450-4f42-b87a-5379493eeea8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:18.257846 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0d9b2ff3-c450-4f42-b87a-5379493eeea8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:18.402605 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-0d9b2ff3-c450-4f42-b87a-5379493eeea8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:18.411244 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-0d9b2ff3-c450-4f42-b87a-5379493eeea8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:18.412756 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-0d9b2ff3-c450-4f42-b87a-5379493eeea8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:18.413905 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-0d9b2ff3-c450-4f42-b87a-5379493eeea8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1739 microversion: 2.20 time: 0.175293 Oct 24 08:51:18.420337 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 245/489] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:18 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:19.440793 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-228e48e6-4b4c-469f-b6d4-8b116890fcfd tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:19.441398 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-228e48e6-4b4c-469f-b6d4-8b116890fcfd tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:19.447990 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-228e48e6-4b4c-469f-b6d4-8b116890fcfd tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:19.448552 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-228e48e6-4b4c-469f-b6d4-8b116890fcfd tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:19.448976 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-228e48e6-4b4c-469f-b6d4-8b116890fcfd tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:19.449692 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-228e48e6-4b4c-469f-b6d4-8b116890fcfd tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:19.450117 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-228e48e6-4b4c-469f-b6d4-8b116890fcfd tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:19.450527 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-228e48e6-4b4c-469f-b6d4-8b116890fcfd tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:19.592340 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-228e48e6-4b4c-469f-b6d4-8b116890fcfd tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:19.600767 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-228e48e6-4b4c-469f-b6d4-8b116890fcfd tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:19.602178 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-228e48e6-4b4c-469f-b6d4-8b116890fcfd tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:19.603328 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-228e48e6-4b4c-469f-b6d4-8b116890fcfd tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1739 microversion: 2.20 time: 0.166959 Oct 24 08:51:19.603868 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 245/490] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:19 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:20.632029 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-a7be367b-3e3f-446a-9b6b-a8d857450383 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:20.633209 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-a7be367b-3e3f-446a-9b6b-a8d857450383 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:20.638826 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_api:SELECT=34 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:20.644345 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a7be367b-3e3f-446a-9b6b-a8d857450383 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:20.644875 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a7be367b-3e3f-446a-9b6b-a8d857450383 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:20.645521 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a7be367b-3e3f-446a-9b6b-a8d857450383 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:20.646213 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a7be367b-3e3f-446a-9b6b-a8d857450383 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:20.646666 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a7be367b-3e3f-446a-9b6b-a8d857450383 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:20.647116 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a7be367b-3e3f-446a-9b6b-a8d857450383 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:20.889267 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-a7be367b-3e3f-446a-9b6b-a8d857450383 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:20.898206 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-a7be367b-3e3f-446a-9b6b-a8d857450383 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:20.899650 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-a7be367b-3e3f-446a-9b6b-a8d857450383 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:20.900977 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-a7be367b-3e3f-446a-9b6b-a8d857450383 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1721 microversion: 2.20 time: 0.275978 Oct 24 08:51:20.901533 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 246/491] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:20 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1721 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:21.931484 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-093f30eb-dba6-44e2-a384-6be544b9bdbe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:21.933323 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-093f30eb-dba6-44e2-a384-6be544b9bdbe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:21.941537 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-093f30eb-dba6-44e2-a384-6be544b9bdbe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:21.942050 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-093f30eb-dba6-44e2-a384-6be544b9bdbe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:21.942516 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-093f30eb-dba6-44e2-a384-6be544b9bdbe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:21.943240 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-093f30eb-dba6-44e2-a384-6be544b9bdbe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:21.943685 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-093f30eb-dba6-44e2-a384-6be544b9bdbe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:21.944106 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-093f30eb-dba6-44e2-a384-6be544b9bdbe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:22.080005 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-093f30eb-dba6-44e2-a384-6be544b9bdbe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:22.088085 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-093f30eb-dba6-44e2-a384-6be544b9bdbe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:22.089490 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-093f30eb-dba6-44e2-a384-6be544b9bdbe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:22.090634 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-093f30eb-dba6-44e2-a384-6be544b9bdbe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1721 microversion: 2.20 time: 0.165694 Oct 24 08:51:22.091215 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 246/492] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:21 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:23.055712 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-e10fbf93-7011-49ed-a01b-24b0c8637711 req-d5d4bb7b-c0b2-44cb-9b7e-2b1fd91cea04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf8e51c6-99cf-49c6-b25b-89c3c7045e4e", "name": "network-vif-unplugged", "status": "completed", "tag": "c7a98c12-528e-4bbb-9ae8-1c8aaf7fbba9"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:23.066208 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-e10fbf93-7011-49ed-a01b-24b0c8637711 req-d5d4bb7b-c0b2-44cb-9b7e-2b1fd91cea04 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:23.066572 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-e10fbf93-7011-49ed-a01b-24b0c8637711 req-d5d4bb7b-c0b2-44cb-9b7e-2b1fd91cea04 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:23.067010 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-e10fbf93-7011-49ed-a01b-24b0c8637711 req-d5d4bb7b-c0b2-44cb-9b7e-2b1fd91cea04 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:23.069691 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell1:SELECT=87 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:23.079859 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-e10fbf93-7011-49ed-a01b-24b0c8637711 req-d5d4bb7b-c0b2-44cb-9b7e-2b1fd91cea04 service nova] Creating event network-vif-unplugged:c7a98c12-528e-4bbb-9ae8-1c8aaf7fbba9 for instance cf8e51c6-99cf-49c6-b25b-89c3c7045e4e on hv-cinder-maste Oct 24 08:51:23.085089 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-e10fbf93-7011-49ed-a01b-24b0c8637711 req-d5d4bb7b-c0b2-44cb-9b7e-2b1fd91cea04 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033130 Oct 24 08:51:23.085663 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 247/493] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:23.123414 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-4dd0f80a-f8d9-46a6-88a0-5070780660c4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:23.124020 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-4dd0f80a-f8d9-46a6-88a0-5070780660c4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:23.130209 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4dd0f80a-f8d9-46a6-88a0-5070780660c4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:23.130694 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4dd0f80a-f8d9-46a6-88a0-5070780660c4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:23.131165 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4dd0f80a-f8d9-46a6-88a0-5070780660c4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:23.131843 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4dd0f80a-f8d9-46a6-88a0-5070780660c4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:23.132291 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4dd0f80a-f8d9-46a6-88a0-5070780660c4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:23.132709 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4dd0f80a-f8d9-46a6-88a0-5070780660c4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:23.274821 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-4dd0f80a-f8d9-46a6-88a0-5070780660c4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:23.283597 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-4dd0f80a-f8d9-46a6-88a0-5070780660c4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:23.285015 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-4dd0f80a-f8d9-46a6-88a0-5070780660c4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:23.286165 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-4dd0f80a-f8d9-46a6-88a0-5070780660c4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1721 microversion: 2.20 time: 0.166842 Oct 24 08:51:23.286733 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 247/494] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:23 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:24.313599 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-395cdabf-6c5a-48c1-a637-d177cce09568 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:24.314325 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-395cdabf-6c5a-48c1-a637-d177cce09568 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:24.321208 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-395cdabf-6c5a-48c1-a637-d177cce09568 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:24.321697 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-395cdabf-6c5a-48c1-a637-d177cce09568 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:24.322126 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-395cdabf-6c5a-48c1-a637-d177cce09568 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:24.322844 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-395cdabf-6c5a-48c1-a637-d177cce09568 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:24.323296 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-395cdabf-6c5a-48c1-a637-d177cce09568 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:24.323716 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-395cdabf-6c5a-48c1-a637-d177cce09568 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:24.459506 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-395cdabf-6c5a-48c1-a637-d177cce09568 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:24.467628 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-395cdabf-6c5a-48c1-a637-d177cce09568 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:24.469048 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-395cdabf-6c5a-48c1-a637-d177cce09568 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:24.470212 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-395cdabf-6c5a-48c1-a637-d177cce09568 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1664 microversion: 2.20 time: 0.161572 Oct 24 08:51:24.470776 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 248/495] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:24 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1664 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:24.497742 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-4db641e2-eadf-4992-b7e1-ba4bc2ee07e4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "847a11f9-aec6-4b79-86ff-64e7465c3798"}} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:24.501623 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-4db641e2-eadf-4992-b7e1-ba4bc2ee07e4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:24.514342 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4db641e2-eadf-4992-b7e1-ba4bc2ee07e4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:24.515105 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4db641e2-eadf-4992-b7e1-ba4bc2ee07e4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:24.515806 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4db641e2-eadf-4992-b7e1-ba4bc2ee07e4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:24.516842 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4db641e2-eadf-4992-b7e1-ba4bc2ee07e4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:24.517547 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4db641e2-eadf-4992-b7e1-ba4bc2ee07e4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:24.518045 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4db641e2-eadf-4992-b7e1-ba4bc2ee07e4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:24.820416 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-4db641e2-eadf-4992-b7e1-ba4bc2ee07e4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "POST /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.329471 Oct 24 08:51:24.821079 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 248/496] 10.222.0.26 () {62 vars in 1364 bytes} [Mon Oct 24 08:51:24 2022] POST /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e/os-volume_attachments => generated 188 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:51:24.947459 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-e441ebfb-2014-473d-a85d-9d92523e1948 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:24.948040 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-e441ebfb-2014-473d-a85d-9d92523e1948 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:24.954008 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e441ebfb-2014-473d-a85d-9d92523e1948 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:24.954490 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e441ebfb-2014-473d-a85d-9d92523e1948 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:24.955047 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e441ebfb-2014-473d-a85d-9d92523e1948 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:24.955729 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e441ebfb-2014-473d-a85d-9d92523e1948 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:24.956173 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e441ebfb-2014-473d-a85d-9d92523e1948 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:24.956588 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e441ebfb-2014-473d-a85d-9d92523e1948 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:25.009544 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-e441ebfb-2014-473d-a85d-9d92523e1948 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125164) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 24 08:51:25.080678 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-e441ebfb-2014-473d-a85d-9d92523e1948 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "POST /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e/action" status: 202 len: 0 microversion: 2.20 time: 0.136858 Oct 24 08:51:25.081168 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 249/497] 10.222.0.26 () {62 vars in 1319 bytes} [Mon Oct 24 08:51:24 2022] POST /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:51:25.089466 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-a1270b44-cff8-42f1-887f-af4a0dac0673 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:25.090079 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-a1270b44-cff8-42f1-887f-af4a0dac0673 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:25.095958 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a1270b44-cff8-42f1-887f-af4a0dac0673 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:25.096510 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a1270b44-cff8-42f1-887f-af4a0dac0673 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:25.096991 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a1270b44-cff8-42f1-887f-af4a0dac0673 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:25.097870 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a1270b44-cff8-42f1-887f-af4a0dac0673 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:25.098316 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a1270b44-cff8-42f1-887f-af4a0dac0673 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:25.098747 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a1270b44-cff8-42f1-887f-af4a0dac0673 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:25.229391 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a1270b44-cff8-42f1-887f-af4a0dac0673 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:25.238441 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a1270b44-cff8-42f1-887f-af4a0dac0673 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:25.239916 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a1270b44-cff8-42f1-887f-af4a0dac0673 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:25.241060 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-a1270b44-cff8-42f1-887f-af4a0dac0673 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1750 microversion: 2.20 time: 0.155541 Oct 24 08:51:25.241623 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 249/498] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:25 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1750 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:26.266264 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-0a16c1ca-f34d-42b9-a7aa-5ce7e940f867 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:26.266910 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-0a16c1ca-f34d-42b9-a7aa-5ce7e940f867 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:26.273105 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0a16c1ca-f34d-42b9-a7aa-5ce7e940f867 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:26.273620 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0a16c1ca-f34d-42b9-a7aa-5ce7e940f867 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:26.274416 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0a16c1ca-f34d-42b9-a7aa-5ce7e940f867 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:26.274760 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0a16c1ca-f34d-42b9-a7aa-5ce7e940f867 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:26.275321 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0a16c1ca-f34d-42b9-a7aa-5ce7e940f867 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:26.275589 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0a16c1ca-f34d-42b9-a7aa-5ce7e940f867 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:26.406040 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-0a16c1ca-f34d-42b9-a7aa-5ce7e940f867 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:26.414668 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-0a16c1ca-f34d-42b9-a7aa-5ce7e940f867 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:26.416113 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-0a16c1ca-f34d-42b9-a7aa-5ce7e940f867 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:26.417275 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-0a16c1ca-f34d-42b9-a7aa-5ce7e940f867 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1752 microversion: 2.20 time: 0.155556 Oct 24 08:51:26.418127 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 250/499] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:26 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:27.448985 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-260d432c-5d15-452b-86a2-163ff237870f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:27.450222 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-260d432c-5d15-452b-86a2-163ff237870f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:27.458329 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-260d432c-5d15-452b-86a2-163ff237870f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:27.458966 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-260d432c-5d15-452b-86a2-163ff237870f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:27.459405 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-260d432c-5d15-452b-86a2-163ff237870f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:27.460087 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-260d432c-5d15-452b-86a2-163ff237870f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:27.460535 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-260d432c-5d15-452b-86a2-163ff237870f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:27.461070 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-260d432c-5d15-452b-86a2-163ff237870f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:27.649857 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-260d432c-5d15-452b-86a2-163ff237870f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:27.659328 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-260d432c-5d15-452b-86a2-163ff237870f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:27.660859 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-260d432c-5d15-452b-86a2-163ff237870f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:27.662042 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-260d432c-5d15-452b-86a2-163ff237870f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1808 microversion: 2.20 time: 0.219801 Oct 24 08:51:27.662606 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 250/500] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:27 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:28.687752 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-0423dc4d-f5ee-4d07-8f91-23940d815c4d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:28.688369 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-0423dc4d-f5ee-4d07-8f91-23940d815c4d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:28.698312 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0423dc4d-f5ee-4d07-8f91-23940d815c4d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:28.699194 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0423dc4d-f5ee-4d07-8f91-23940d815c4d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:28.699887 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0423dc4d-f5ee-4d07-8f91-23940d815c4d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:28.700832 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0423dc4d-f5ee-4d07-8f91-23940d815c4d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:28.701517 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0423dc4d-f5ee-4d07-8f91-23940d815c4d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:28.702166 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0423dc4d-f5ee-4d07-8f91-23940d815c4d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:28.842064 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-0423dc4d-f5ee-4d07-8f91-23940d815c4d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:28.851951 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-0423dc4d-f5ee-4d07-8f91-23940d815c4d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:28.853603 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-0423dc4d-f5ee-4d07-8f91-23940d815c4d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:28.854923 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-0423dc4d-f5ee-4d07-8f91-23940d815c4d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1808 microversion: 2.20 time: 0.171131 Oct 24 08:51:28.855669 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 251/501] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:28 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:29.881600 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-f543d349-b150-4845-8ea6-97367b0a2387 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:29.882174 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-f543d349-b150-4845-8ea6-97367b0a2387 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:29.888862 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f543d349-b150-4845-8ea6-97367b0a2387 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:29.889339 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f543d349-b150-4845-8ea6-97367b0a2387 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:29.889759 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f543d349-b150-4845-8ea6-97367b0a2387 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:29.890439 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f543d349-b150-4845-8ea6-97367b0a2387 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:29.890912 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f543d349-b150-4845-8ea6-97367b0a2387 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:29.891331 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f543d349-b150-4845-8ea6-97367b0a2387 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:30.034156 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-f543d349-b150-4845-8ea6-97367b0a2387 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:30.043644 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-f543d349-b150-4845-8ea6-97367b0a2387 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:30.045052 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-f543d349-b150-4845-8ea6-97367b0a2387 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:30.046197 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-f543d349-b150-4845-8ea6-97367b0a2387 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1808 microversion: 2.20 time: 0.168561 Oct 24 08:51:30.046824 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 251/502] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:29 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:31.071804 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-5d079e54-e055-45da-a9bf-b6d0efb1a453 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:31.072427 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-5d079e54-e055-45da-a9bf-b6d0efb1a453 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:31.079172 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5d079e54-e055-45da-a9bf-b6d0efb1a453 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:31.079730 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5d079e54-e055-45da-a9bf-b6d0efb1a453 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:31.080167 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5d079e54-e055-45da-a9bf-b6d0efb1a453 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:31.080851 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5d079e54-e055-45da-a9bf-b6d0efb1a453 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:31.081301 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5d079e54-e055-45da-a9bf-b6d0efb1a453 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:31.081720 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5d079e54-e055-45da-a9bf-b6d0efb1a453 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:31.222069 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-5d079e54-e055-45da-a9bf-b6d0efb1a453 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:31.230798 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-5d079e54-e055-45da-a9bf-b6d0efb1a453 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:31.232210 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-5d079e54-e055-45da-a9bf-b6d0efb1a453 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:31.233356 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-5d079e54-e055-45da-a9bf-b6d0efb1a453 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1808 microversion: 2.20 time: 0.165723 Oct 24 08:51:31.233929 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 252/503] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:31 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:32.258843 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-a601c97e-2451-498a-87b8-fea56b619c4b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:32.259423 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-a601c97e-2451-498a-87b8-fea56b619c4b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:32.265774 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a601c97e-2451-498a-87b8-fea56b619c4b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:32.266268 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a601c97e-2451-498a-87b8-fea56b619c4b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:32.266701 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a601c97e-2451-498a-87b8-fea56b619c4b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:32.267417 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a601c97e-2451-498a-87b8-fea56b619c4b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:32.267870 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a601c97e-2451-498a-87b8-fea56b619c4b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:32.268282 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a601c97e-2451-498a-87b8-fea56b619c4b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:32.405053 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a601c97e-2451-498a-87b8-fea56b619c4b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:32.413877 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a601c97e-2451-498a-87b8-fea56b619c4b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:32.415346 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a601c97e-2451-498a-87b8-fea56b619c4b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:32.416488 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-a601c97e-2451-498a-87b8-fea56b619c4b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1808 microversion: 2.20 time: 0.161622 Oct 24 08:51:32.417043 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 252/504] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:32 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:33.446010 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-97c91c5d-540b-43f8-9f6d-a8664ccd762b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:33.446945 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-97c91c5d-540b-43f8-9f6d-a8664ccd762b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:33.455056 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-97c91c5d-540b-43f8-9f6d-a8664ccd762b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:33.455633 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-97c91c5d-540b-43f8-9f6d-a8664ccd762b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:33.456129 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-97c91c5d-540b-43f8-9f6d-a8664ccd762b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:33.457070 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-97c91c5d-540b-43f8-9f6d-a8664ccd762b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:33.457602 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-97c91c5d-540b-43f8-9f6d-a8664ccd762b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:33.458081 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-97c91c5d-540b-43f8-9f6d-a8664ccd762b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:33.589573 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-97c91c5d-540b-43f8-9f6d-a8664ccd762b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:33.598929 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-97c91c5d-540b-43f8-9f6d-a8664ccd762b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:33.600345 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-97c91c5d-540b-43f8-9f6d-a8664ccd762b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:33.601570 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-97c91c5d-540b-43f8-9f6d-a8664ccd762b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1808 microversion: 2.20 time: 0.161708 Oct 24 08:51:33.617466 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 253/505] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:33 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:34.628056 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-04eb6589-837a-4e3e-a617-83b05a0b9dd7 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:34.628888 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-04eb6589-837a-4e3e-a617-83b05a0b9dd7 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:34.635494 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-04eb6589-837a-4e3e-a617-83b05a0b9dd7 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:34.636519 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-04eb6589-837a-4e3e-a617-83b05a0b9dd7 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:34.636966 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-04eb6589-837a-4e3e-a617-83b05a0b9dd7 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:34.637671 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-04eb6589-837a-4e3e-a617-83b05a0b9dd7 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:34.638122 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-04eb6589-837a-4e3e-a617-83b05a0b9dd7 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:34.638539 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-04eb6589-837a-4e3e-a617-83b05a0b9dd7 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:34.781132 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-04eb6589-837a-4e3e-a617-83b05a0b9dd7 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:34.790066 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-04eb6589-837a-4e3e-a617-83b05a0b9dd7 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:34.791515 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-04eb6589-837a-4e3e-a617-83b05a0b9dd7 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:34.793031 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-04eb6589-837a-4e3e-a617-83b05a0b9dd7 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1808 microversion: 2.20 time: 0.169029 Oct 24 08:51:34.793600 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 253/506] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:34 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:35.819515 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-ac04a7fe-87c1-4024-adda-6389a8dfe715 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:35.820301 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-ac04a7fe-87c1-4024-adda-6389a8dfe715 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:35.827507 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ac04a7fe-87c1-4024-adda-6389a8dfe715 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:35.828007 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ac04a7fe-87c1-4024-adda-6389a8dfe715 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:35.828439 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ac04a7fe-87c1-4024-adda-6389a8dfe715 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:35.829127 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ac04a7fe-87c1-4024-adda-6389a8dfe715 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:35.829579 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ac04a7fe-87c1-4024-adda-6389a8dfe715 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:35.830002 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ac04a7fe-87c1-4024-adda-6389a8dfe715 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:35.966000 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-ac04a7fe-87c1-4024-adda-6389a8dfe715 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:35.980774 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-ac04a7fe-87c1-4024-adda-6389a8dfe715 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:35.982345 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-ac04a7fe-87c1-4024-adda-6389a8dfe715 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:35.983528 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-ac04a7fe-87c1-4024-adda-6389a8dfe715 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1808 microversion: 2.20 time: 0.168092 Oct 24 08:51:35.984353 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 254/507] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:35 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:37.009838 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-5df06892-715e-4fb9-ba0f-af0f3343d487 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:37.010619 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-5df06892-715e-4fb9-ba0f-af0f3343d487 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:37.018561 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5df06892-715e-4fb9-ba0f-af0f3343d487 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:37.019221 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5df06892-715e-4fb9-ba0f-af0f3343d487 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:37.019794 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5df06892-715e-4fb9-ba0f-af0f3343d487 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:37.020680 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5df06892-715e-4fb9-ba0f-af0f3343d487 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:37.021267 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5df06892-715e-4fb9-ba0f-af0f3343d487 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:37.021814 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5df06892-715e-4fb9-ba0f-af0f3343d487 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:37.162043 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-5df06892-715e-4fb9-ba0f-af0f3343d487 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:37.164333 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:37.173143 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-5df06892-715e-4fb9-ba0f-af0f3343d487 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:37.174566 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-5df06892-715e-4fb9-ba0f-af0f3343d487 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:37.175789 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-5df06892-715e-4fb9-ba0f-af0f3343d487 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1808 microversion: 2.20 time: 0.170758 Oct 24 08:51:37.176356 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 254/508] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:37 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:38.203242 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-6605a85d-3605-45d6-9919-59b61bc84456 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:38.204047 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-6605a85d-3605-45d6-9919-59b61bc84456 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:38.211426 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6605a85d-3605-45d6-9919-59b61bc84456 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:38.211854 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6605a85d-3605-45d6-9919-59b61bc84456 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:38.212288 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6605a85d-3605-45d6-9919-59b61bc84456 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:38.213013 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6605a85d-3605-45d6-9919-59b61bc84456 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:38.213460 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6605a85d-3605-45d6-9919-59b61bc84456 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:38.213875 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6605a85d-3605-45d6-9919-59b61bc84456 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:38.348078 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-6605a85d-3605-45d6-9919-59b61bc84456 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:38.357020 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-6605a85d-3605-45d6-9919-59b61bc84456 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:38.358430 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-6605a85d-3605-45d6-9919-59b61bc84456 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:38.359622 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-6605a85d-3605-45d6-9919-59b61bc84456 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1808 microversion: 2.20 time: 0.160635 Oct 24 08:51:38.360183 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 255/509] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:38 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:39.388092 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-61695c78-9b71-4e89-9879-4b8dd60eaf28 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:39.389193 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-61695c78-9b71-4e89-9879-4b8dd60eaf28 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:39.396020 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-61695c78-9b71-4e89-9879-4b8dd60eaf28 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:39.396594 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-61695c78-9b71-4e89-9879-4b8dd60eaf28 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:39.397100 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-61695c78-9b71-4e89-9879-4b8dd60eaf28 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:39.397874 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-61695c78-9b71-4e89-9879-4b8dd60eaf28 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:39.398793 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-61695c78-9b71-4e89-9879-4b8dd60eaf28 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:39.399517 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-61695c78-9b71-4e89-9879-4b8dd60eaf28 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:39.539061 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-61695c78-9b71-4e89-9879-4b8dd60eaf28 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:39.548634 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-61695c78-9b71-4e89-9879-4b8dd60eaf28 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:39.550081 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-61695c78-9b71-4e89-9879-4b8dd60eaf28 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:39.551345 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-61695c78-9b71-4e89-9879-4b8dd60eaf28 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1808 microversion: 2.20 time: 0.167294 Oct 24 08:51:39.551900 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 255/510] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:39 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:40.578188 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-8bb5efb2-e855-4f41-bf15-80b8cdf1ad5d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:40.578856 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-8bb5efb2-e855-4f41-bf15-80b8cdf1ad5d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:40.585875 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8bb5efb2-e855-4f41-bf15-80b8cdf1ad5d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:40.586390 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8bb5efb2-e855-4f41-bf15-80b8cdf1ad5d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:40.586831 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8bb5efb2-e855-4f41-bf15-80b8cdf1ad5d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:40.587540 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8bb5efb2-e855-4f41-bf15-80b8cdf1ad5d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:40.587997 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8bb5efb2-e855-4f41-bf15-80b8cdf1ad5d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:40.588425 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8bb5efb2-e855-4f41-bf15-80b8cdf1ad5d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:40.724168 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-8bb5efb2-e855-4f41-bf15-80b8cdf1ad5d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:40.733740 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-8bb5efb2-e855-4f41-bf15-80b8cdf1ad5d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:40.735240 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-8bb5efb2-e855-4f41-bf15-80b8cdf1ad5d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:40.736475 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-8bb5efb2-e855-4f41-bf15-80b8cdf1ad5d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1808 microversion: 2.20 time: 0.162798 Oct 24 08:51:40.737109 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 256/511] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:40 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:41.765722 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-069ddf5d-5a2e-480b-8f5d-17ff0992eb46 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:41.766402 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-069ddf5d-5a2e-480b-8f5d-17ff0992eb46 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:41.774308 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-069ddf5d-5a2e-480b-8f5d-17ff0992eb46 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:41.774829 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-069ddf5d-5a2e-480b-8f5d-17ff0992eb46 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:41.775273 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-069ddf5d-5a2e-480b-8f5d-17ff0992eb46 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:41.776075 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-069ddf5d-5a2e-480b-8f5d-17ff0992eb46 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:41.776557 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-069ddf5d-5a2e-480b-8f5d-17ff0992eb46 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:41.776985 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-069ddf5d-5a2e-480b-8f5d-17ff0992eb46 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:41.912420 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-069ddf5d-5a2e-480b-8f5d-17ff0992eb46 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:41.923801 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-069ddf5d-5a2e-480b-8f5d-17ff0992eb46 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:41.925205 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-069ddf5d-5a2e-480b-8f5d-17ff0992eb46 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:41.926455 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-069ddf5d-5a2e-480b-8f5d-17ff0992eb46 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1808 microversion: 2.20 time: 0.167424 Oct 24 08:51:41.927059 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 256/512] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:41 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:42.957495 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-e3008020-d439-4df4-bc54-a74cd490cb48 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:42.958540 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-e3008020-d439-4df4-bc54-a74cd490cb48 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:42.969249 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e3008020-d439-4df4-bc54-a74cd490cb48 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:42.970104 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e3008020-d439-4df4-bc54-a74cd490cb48 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:42.970805 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e3008020-d439-4df4-bc54-a74cd490cb48 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:42.971991 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e3008020-d439-4df4-bc54-a74cd490cb48 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:42.972745 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e3008020-d439-4df4-bc54-a74cd490cb48 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:42.973434 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e3008020-d439-4df4-bc54-a74cd490cb48 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:43.118286 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-e3008020-d439-4df4-bc54-a74cd490cb48 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:43.130702 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-e3008020-d439-4df4-bc54-a74cd490cb48 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:43.132947 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-e3008020-d439-4df4-bc54-a74cd490cb48 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:43.134954 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-e3008020-d439-4df4-bc54-a74cd490cb48 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1808 microversion: 2.20 time: 0.183696 Oct 24 08:51:43.135521 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 257/513] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:42 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:44.161286 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-5f12a1bf-9e0e-4719-b36d-4097b49db3cc tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:44.164016 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-5f12a1bf-9e0e-4719-b36d-4097b49db3cc tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:44.169633 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5f12a1bf-9e0e-4719-b36d-4097b49db3cc tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:44.170188 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5f12a1bf-9e0e-4719-b36d-4097b49db3cc tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:44.170667 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5f12a1bf-9e0e-4719-b36d-4097b49db3cc tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:44.171476 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5f12a1bf-9e0e-4719-b36d-4097b49db3cc tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:44.171990 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5f12a1bf-9e0e-4719-b36d-4097b49db3cc tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:44.172478 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5f12a1bf-9e0e-4719-b36d-4097b49db3cc tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:44.309362 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-5f12a1bf-9e0e-4719-b36d-4097b49db3cc tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:44.322023 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-5f12a1bf-9e0e-4719-b36d-4097b49db3cc tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:44.323540 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-5f12a1bf-9e0e-4719-b36d-4097b49db3cc tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:44.324656 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-5f12a1bf-9e0e-4719-b36d-4097b49db3cc tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1808 microversion: 2.20 time: 0.167927 Oct 24 08:51:44.325532 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 257/514] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:44 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:45.353909 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-ae148889-4ae6-475f-a30c-fd2cf25e85b9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:45.354774 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-ae148889-4ae6-475f-a30c-fd2cf25e85b9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:45.363504 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ae148889-4ae6-475f-a30c-fd2cf25e85b9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:45.364140 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ae148889-4ae6-475f-a30c-fd2cf25e85b9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:45.364716 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ae148889-4ae6-475f-a30c-fd2cf25e85b9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:45.365617 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ae148889-4ae6-475f-a30c-fd2cf25e85b9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:45.366209 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ae148889-4ae6-475f-a30c-fd2cf25e85b9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:45.366786 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ae148889-4ae6-475f-a30c-fd2cf25e85b9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:45.517313 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-ae148889-4ae6-475f-a30c-fd2cf25e85b9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:45.526469 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-ae148889-4ae6-475f-a30c-fd2cf25e85b9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:45.527962 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-ae148889-4ae6-475f-a30c-fd2cf25e85b9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:45.529108 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-ae148889-4ae6-475f-a30c-fd2cf25e85b9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1808 microversion: 2.20 time: 0.182073 Oct 24 08:51:45.529693 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 258/515] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:45 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:46.557841 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-ba9e1e02-1900-45e0-81fa-1f60a70e9b99 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:46.558654 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-ba9e1e02-1900-45e0-81fa-1f60a70e9b99 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:46.562052 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_api:SELECT=30 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:46.570703 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ba9e1e02-1900-45e0-81fa-1f60a70e9b99 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:46.571550 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ba9e1e02-1900-45e0-81fa-1f60a70e9b99 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:46.572273 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ba9e1e02-1900-45e0-81fa-1f60a70e9b99 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:46.573219 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ba9e1e02-1900-45e0-81fa-1f60a70e9b99 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:46.573676 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ba9e1e02-1900-45e0-81fa-1f60a70e9b99 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:46.574092 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ba9e1e02-1900-45e0-81fa-1f60a70e9b99 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:46.713586 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-ba9e1e02-1900-45e0-81fa-1f60a70e9b99 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:46.722331 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-ba9e1e02-1900-45e0-81fa-1f60a70e9b99 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:46.723760 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-ba9e1e02-1900-45e0-81fa-1f60a70e9b99 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:46.724897 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-ba9e1e02-1900-45e0-81fa-1f60a70e9b99 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1808 microversion: 2.20 time: 0.173850 Oct 24 08:51:46.725447 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 258/516] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:46 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:47.751417 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-789ac24a-efeb-4af2-9e58-8a40ac569c65 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:47.751417 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-789ac24a-efeb-4af2-9e58-8a40ac569c65 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:47.758818 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-789ac24a-efeb-4af2-9e58-8a40ac569c65 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:47.759300 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-789ac24a-efeb-4af2-9e58-8a40ac569c65 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:47.759730 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-789ac24a-efeb-4af2-9e58-8a40ac569c65 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:47.760449 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-789ac24a-efeb-4af2-9e58-8a40ac569c65 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:47.760895 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-789ac24a-efeb-4af2-9e58-8a40ac569c65 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:47.761305 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-789ac24a-efeb-4af2-9e58-8a40ac569c65 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:47.895683 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-789ac24a-efeb-4af2-9e58-8a40ac569c65 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:47.904281 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-789ac24a-efeb-4af2-9e58-8a40ac569c65 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:47.905692 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-789ac24a-efeb-4af2-9e58-8a40ac569c65 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:47.906827 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-789ac24a-efeb-4af2-9e58-8a40ac569c65 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1808 microversion: 2.20 time: 0.160441 Oct 24 08:51:47.907413 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 259/517] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:47 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:48.933145 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-f78b3b33-a356-4132-9714-ccac9fdc98b8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:48.933758 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-f78b3b33-a356-4132-9714-ccac9fdc98b8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:48.941005 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f78b3b33-a356-4132-9714-ccac9fdc98b8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:48.941579 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f78b3b33-a356-4132-9714-ccac9fdc98b8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:48.942091 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f78b3b33-a356-4132-9714-ccac9fdc98b8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:48.942928 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f78b3b33-a356-4132-9714-ccac9fdc98b8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:48.943458 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f78b3b33-a356-4132-9714-ccac9fdc98b8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:48.943950 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f78b3b33-a356-4132-9714-ccac9fdc98b8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:49.083109 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-f78b3b33-a356-4132-9714-ccac9fdc98b8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:49.097264 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-f78b3b33-a356-4132-9714-ccac9fdc98b8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:49.099470 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-f78b3b33-a356-4132-9714-ccac9fdc98b8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:49.101247 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-f78b3b33-a356-4132-9714-ccac9fdc98b8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1808 microversion: 2.20 time: 0.172593 Oct 24 08:51:49.101934 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 259/518] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:48 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:50.128097 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-adf7c407-c7ba-414c-944a-aa9981ae99ff tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:50.128665 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-adf7c407-c7ba-414c-944a-aa9981ae99ff tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:50.137179 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-adf7c407-c7ba-414c-944a-aa9981ae99ff tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:50.137839 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-adf7c407-c7ba-414c-944a-aa9981ae99ff tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:50.138370 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-adf7c407-c7ba-414c-944a-aa9981ae99ff tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:50.139377 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-adf7c407-c7ba-414c-944a-aa9981ae99ff tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:50.139904 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-adf7c407-c7ba-414c-944a-aa9981ae99ff tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:50.140323 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-adf7c407-c7ba-414c-944a-aa9981ae99ff tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:50.289296 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-adf7c407-c7ba-414c-944a-aa9981ae99ff tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:50.299043 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-adf7c407-c7ba-414c-944a-aa9981ae99ff tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:50.300464 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-adf7c407-c7ba-414c-944a-aa9981ae99ff tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:50.301615 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-adf7c407-c7ba-414c-944a-aa9981ae99ff tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1808 microversion: 2.20 time: 0.177654 Oct 24 08:51:50.302174 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 260/519] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:50 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:51:50.833445 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-9edc46fa-6f61-4cb6-9ea9-636808540501 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:50.835768 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-9edc46fa-6f61-4cb6-9ea9-636808540501 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:50.841901 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9edc46fa-6f61-4cb6-9ea9-636808540501 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:50.842372 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9edc46fa-6f61-4cb6-9ea9-636808540501 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:50.842826 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9edc46fa-6f61-4cb6-9ea9-636808540501 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:50.843541 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9edc46fa-6f61-4cb6-9ea9-636808540501 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:50.843956 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9edc46fa-6f61-4cb6-9ea9-636808540501 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:50.844387 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9edc46fa-6f61-4cb6-9ea9-636808540501 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:50.918468 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-9edc46fa-6f61-4cb6-9ea9-636808540501 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "POST /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1/action" status: 202 len: 0 microversion: 2.1 time: 0.088403 Oct 24 08:51:50.919233 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 260/520] 10.222.0.26 () {60 vars in 1278 bytes} [Mon Oct 24 08:51:50 2022] POST /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:51:50.929852 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-ca81654e-5956-47a6-8d73-b9d63419aee0 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:50.930877 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-ca81654e-5956-47a6-8d73-b9d63419aee0 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:50.937060 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:50.938936 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ca81654e-5956-47a6-8d73-b9d63419aee0 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:50.939515 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ca81654e-5956-47a6-8d73-b9d63419aee0 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:50.939886 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ca81654e-5956-47a6-8d73-b9d63419aee0 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:50.940612 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ca81654e-5956-47a6-8d73-b9d63419aee0 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:50.941066 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ca81654e-5956-47a6-8d73-b9d63419aee0 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:50.941523 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ca81654e-5956-47a6-8d73-b9d63419aee0 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:51.092475 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-ca81654e-5956-47a6-8d73-b9d63419aee0 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:51.103682 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-ca81654e-5956-47a6-8d73-b9d63419aee0 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1750 microversion: 2.1 time: 0.180218 Oct 24 08:51:51.104376 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 261/521] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:50 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1750 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:51:51.327795 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-97927089-ce12-42f5-9e37-bc7bc476b466 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:51.328540 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-97927089-ce12-42f5-9e37-bc7bc476b466 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:51.336071 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-97927089-ce12-42f5-9e37-bc7bc476b466 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:51.337313 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-97927089-ce12-42f5-9e37-bc7bc476b466 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:51.338151 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-97927089-ce12-42f5-9e37-bc7bc476b466 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:51.339148 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-97927089-ce12-42f5-9e37-bc7bc476b466 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:51.339854 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-97927089-ce12-42f5-9e37-bc7bc476b466 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:51.340474 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-97927089-ce12-42f5-9e37-bc7bc476b466 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:51.547105 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-97927089-ce12-42f5-9e37-bc7bc476b466 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:51.557137 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-97927089-ce12-42f5-9e37-bc7bc476b466 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:51.558568 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-97927089-ce12-42f5-9e37-bc7bc476b466 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:51.559756 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-97927089-ce12-42f5-9e37-bc7bc476b466 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1808 microversion: 2.20 time: 0.236900 Oct 24 08:51:51.560302 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 261/522] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:51 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1808 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:52.130112 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-a05e319a-8f6c-4db6-91ce-35945b3d149b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:52.131193 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-a05e319a-8f6c-4db6-91ce-35945b3d149b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:52.139101 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a05e319a-8f6c-4db6-91ce-35945b3d149b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:52.139589 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a05e319a-8f6c-4db6-91ce-35945b3d149b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:52.140015 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a05e319a-8f6c-4db6-91ce-35945b3d149b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:52.140692 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a05e319a-8f6c-4db6-91ce-35945b3d149b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:52.141137 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a05e319a-8f6c-4db6-91ce-35945b3d149b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:52.141537 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a05e319a-8f6c-4db6-91ce-35945b3d149b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:52.289658 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-a05e319a-8f6c-4db6-91ce-35945b3d149b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:52.298519 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-a05e319a-8f6c-4db6-91ce-35945b3d149b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1755 microversion: 2.1 time: 0.173775 Oct 24 08:51:52.299095 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 262/523] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:52 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:52.589449 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-5c428ed1-86ad-4c8d-a983-d9caa6c486af tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:52.590459 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-5c428ed1-86ad-4c8d-a983-d9caa6c486af tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:52.600807 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5c428ed1-86ad-4c8d-a983-d9caa6c486af tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:52.601601 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5c428ed1-86ad-4c8d-a983-d9caa6c486af tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:52.602308 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5c428ed1-86ad-4c8d-a983-d9caa6c486af tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:52.603476 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5c428ed1-86ad-4c8d-a983-d9caa6c486af tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:52.604184 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5c428ed1-86ad-4c8d-a983-d9caa6c486af tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:52.604627 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5c428ed1-86ad-4c8d-a983-d9caa6c486af tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:52.737845 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-5c428ed1-86ad-4c8d-a983-d9caa6c486af tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:52.745960 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-5c428ed1-86ad-4c8d-a983-d9caa6c486af tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:52.747434 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-5c428ed1-86ad-4c8d-a983-d9caa6c486af tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:52.748569 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-5c428ed1-86ad-4c8d-a983-d9caa6c486af tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1808 microversion: 2.20 time: 0.166551 Oct 24 08:51:52.749122 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 262/524] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:52 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:53.321915 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-e6586b12-2784-42c5-a61b-271600e937f0 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:53.322600 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-e6586b12-2784-42c5-a61b-271600e937f0 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:53.329363 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e6586b12-2784-42c5-a61b-271600e937f0 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:53.329842 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e6586b12-2784-42c5-a61b-271600e937f0 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:53.330269 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e6586b12-2784-42c5-a61b-271600e937f0 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:53.330990 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e6586b12-2784-42c5-a61b-271600e937f0 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:53.331452 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e6586b12-2784-42c5-a61b-271600e937f0 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:53.331859 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e6586b12-2784-42c5-a61b-271600e937f0 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:53.334416 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:53.399319 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-ebd0a707-172d-4d81-b093-62754873b557 req-60f9589e-2d9e-4d5d-a8ec-36f1ff76d392 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf8e51c6-99cf-49c6-b25b-89c3c7045e4e", "name": "network-vif-plugged", "status": "completed", "tag": "c7a98c12-528e-4bbb-9ae8-1c8aaf7fbba9"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:51:53.409425 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-ebd0a707-172d-4d81-b093-62754873b557 req-60f9589e-2d9e-4d5d-a8ec-36f1ff76d392 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:53.409932 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-ebd0a707-172d-4d81-b093-62754873b557 req-60f9589e-2d9e-4d5d-a8ec-36f1ff76d392 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:53.410391 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-ebd0a707-172d-4d81-b093-62754873b557 req-60f9589e-2d9e-4d5d-a8ec-36f1ff76d392 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:53.422710 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-ebd0a707-172d-4d81-b093-62754873b557 req-60f9589e-2d9e-4d5d-a8ec-36f1ff76d392 service nova] Creating event network-vif-plugged:c7a98c12-528e-4bbb-9ae8-1c8aaf7fbba9 for instance cf8e51c6-99cf-49c6-b25b-89c3c7045e4e on hv-cinder-maste Oct 24 08:51:53.427638 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-ebd0a707-172d-4d81-b093-62754873b557 req-60f9589e-2d9e-4d5d-a8ec-36f1ff76d392 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032193 Oct 24 08:51:53.428233 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 263/525] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:51:53.483311 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-e6586b12-2784-42c5-a61b-271600e937f0 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:53.492116 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-e6586b12-2784-42c5-a61b-271600e937f0 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1755 microversion: 2.1 time: 0.174350 Oct 24 08:51:53.492691 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 263/526] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:53 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:53.778226 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-cf9080e8-b8b7-481d-8378-ac0d1ff2c194 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:53.779137 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-cf9080e8-b8b7-481d-8378-ac0d1ff2c194 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:53.787364 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cf9080e8-b8b7-481d-8378-ac0d1ff2c194 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:53.787974 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cf9080e8-b8b7-481d-8378-ac0d1ff2c194 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:53.788520 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cf9080e8-b8b7-481d-8378-ac0d1ff2c194 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:53.789390 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cf9080e8-b8b7-481d-8378-ac0d1ff2c194 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:53.789960 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cf9080e8-b8b7-481d-8378-ac0d1ff2c194 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:53.790493 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cf9080e8-b8b7-481d-8378-ac0d1ff2c194 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:53.924067 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-cf9080e8-b8b7-481d-8378-ac0d1ff2c194 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:53.933160 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-cf9080e8-b8b7-481d-8378-ac0d1ff2c194 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:53.935173 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-cf9080e8-b8b7-481d-8378-ac0d1ff2c194 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:53.936373 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-cf9080e8-b8b7-481d-8378-ac0d1ff2c194 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1808 microversion: 2.20 time: 0.164759 Oct 24 08:51:53.936936 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 264/527] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:53 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:54.520141 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-c2eb5b18-48f2-433a-8362-0605f863ae92 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:54.520997 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-c2eb5b18-48f2-433a-8362-0605f863ae92 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:54.529740 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c2eb5b18-48f2-433a-8362-0605f863ae92 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:54.530222 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c2eb5b18-48f2-433a-8362-0605f863ae92 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:54.530654 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c2eb5b18-48f2-433a-8362-0605f863ae92 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:54.531458 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c2eb5b18-48f2-433a-8362-0605f863ae92 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:54.531912 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c2eb5b18-48f2-433a-8362-0605f863ae92 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:54.532351 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c2eb5b18-48f2-433a-8362-0605f863ae92 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:54.681102 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-c2eb5b18-48f2-433a-8362-0605f863ae92 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:54.690855 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-c2eb5b18-48f2-433a-8362-0605f863ae92 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1755 microversion: 2.1 time: 0.177283 Oct 24 08:51:54.691399 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 264/528] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:54 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:54.965340 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-53ccc0e8-6fb7-41be-a952-d2a4276d77c8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:54.966365 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-53ccc0e8-6fb7-41be-a952-d2a4276d77c8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:54.976381 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-53ccc0e8-6fb7-41be-a952-d2a4276d77c8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:54.977185 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-53ccc0e8-6fb7-41be-a952-d2a4276d77c8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:54.977889 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-53ccc0e8-6fb7-41be-a952-d2a4276d77c8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:54.979143 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-53ccc0e8-6fb7-41be-a952-d2a4276d77c8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:54.979586 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-53ccc0e8-6fb7-41be-a952-d2a4276d77c8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:54.980001 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-53ccc0e8-6fb7-41be-a952-d2a4276d77c8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:55.119258 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-53ccc0e8-6fb7-41be-a952-d2a4276d77c8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:55.128632 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-53ccc0e8-6fb7-41be-a952-d2a4276d77c8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:55.130100 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-53ccc0e8-6fb7-41be-a952-d2a4276d77c8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:55.131294 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-53ccc0e8-6fb7-41be-a952-d2a4276d77c8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1808 microversion: 2.20 time: 0.172479 Oct 24 08:51:55.131855 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 265/529] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:54 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:55.722359 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-36f75520-58fc-45af-8d6a-416d53e26230 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:55.723024 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-36f75520-58fc-45af-8d6a-416d53e26230 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:55.729933 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-36f75520-58fc-45af-8d6a-416d53e26230 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:55.730434 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-36f75520-58fc-45af-8d6a-416d53e26230 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:55.730899 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-36f75520-58fc-45af-8d6a-416d53e26230 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:55.731595 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-36f75520-58fc-45af-8d6a-416d53e26230 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:55.732050 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-36f75520-58fc-45af-8d6a-416d53e26230 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:55.732465 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-36f75520-58fc-45af-8d6a-416d53e26230 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:55.880397 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-36f75520-58fc-45af-8d6a-416d53e26230 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:55.890437 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-36f75520-58fc-45af-8d6a-416d53e26230 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1755 microversion: 2.1 time: 0.172000 Oct 24 08:51:55.891052 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 265/530] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:55 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:56.157309 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-d03041da-60a9-434f-a5f2-c814b48644b5 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:56.157900 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-d03041da-60a9-434f-a5f2-c814b48644b5 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:56.164283 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d03041da-60a9-434f-a5f2-c814b48644b5 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:56.164772 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d03041da-60a9-434f-a5f2-c814b48644b5 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:56.165188 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d03041da-60a9-434f-a5f2-c814b48644b5 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:56.165874 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d03041da-60a9-434f-a5f2-c814b48644b5 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:56.166343 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d03041da-60a9-434f-a5f2-c814b48644b5 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:56.166747 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d03041da-60a9-434f-a5f2-c814b48644b5 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:56.308790 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-d03041da-60a9-434f-a5f2-c814b48644b5 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:56.318311 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-d03041da-60a9-434f-a5f2-c814b48644b5 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:56.319780 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-d03041da-60a9-434f-a5f2-c814b48644b5 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:56.320942 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-d03041da-60a9-434f-a5f2-c814b48644b5 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1808 microversion: 2.20 time: 0.167601 Oct 24 08:51:56.321504 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 266/531] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:56 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:56.914114 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-7440ce7c-1290-40e0-920c-5225fd8f3dc9 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:56.914794 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-7440ce7c-1290-40e0-920c-5225fd8f3dc9 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:56.922440 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7440ce7c-1290-40e0-920c-5225fd8f3dc9 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:56.922987 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7440ce7c-1290-40e0-920c-5225fd8f3dc9 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:56.923448 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7440ce7c-1290-40e0-920c-5225fd8f3dc9 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:56.924161 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7440ce7c-1290-40e0-920c-5225fd8f3dc9 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:56.924652 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7440ce7c-1290-40e0-920c-5225fd8f3dc9 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:56.925113 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7440ce7c-1290-40e0-920c-5225fd8f3dc9 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:57.078413 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-7440ce7c-1290-40e0-920c-5225fd8f3dc9 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:57.087340 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-7440ce7c-1290-40e0-920c-5225fd8f3dc9 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1755 microversion: 2.1 time: 0.177511 Oct 24 08:51:57.087933 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 266/532] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:56 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:57.346493 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-574f422c-205e-4ade-a8a2-3064233dddec tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:57.347218 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-574f422c-205e-4ade-a8a2-3064233dddec tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:57.353466 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-574f422c-205e-4ade-a8a2-3064233dddec tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:57.354059 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-574f422c-205e-4ade-a8a2-3064233dddec tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:57.354486 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-574f422c-205e-4ade-a8a2-3064233dddec tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:57.355197 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-574f422c-205e-4ade-a8a2-3064233dddec tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:57.355639 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-574f422c-205e-4ade-a8a2-3064233dddec tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:57.356053 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-574f422c-205e-4ade-a8a2-3064233dddec tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:57.486410 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-574f422c-205e-4ade-a8a2-3064233dddec tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:57.495535 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-574f422c-205e-4ade-a8a2-3064233dddec tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:57.496939 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-574f422c-205e-4ade-a8a2-3064233dddec tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:57.498102 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-574f422c-205e-4ade-a8a2-3064233dddec tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1795 microversion: 2.20 time: 0.155890 Oct 24 08:51:57.498692 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 267/533] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:51:57 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1795 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:51:58.114414 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-1f167a96-2b3f-412a-a887-1ff976e9de38 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:58.115469 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-1f167a96-2b3f-412a-a887-1ff976e9de38 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:58.125271 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1f167a96-2b3f-412a-a887-1ff976e9de38 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:58.125895 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1f167a96-2b3f-412a-a887-1ff976e9de38 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:58.126570 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1f167a96-2b3f-412a-a887-1ff976e9de38 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:58.127502 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1f167a96-2b3f-412a-a887-1ff976e9de38 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:58.127962 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1f167a96-2b3f-412a-a887-1ff976e9de38 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:58.128388 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1f167a96-2b3f-412a-a887-1ff976e9de38 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:58.272751 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-1f167a96-2b3f-412a-a887-1ff976e9de38 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:58.282991 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-1f167a96-2b3f-412a-a887-1ff976e9de38 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1755 microversion: 2.1 time: 0.175106 Oct 24 08:51:58.283570 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 267/534] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:58 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:51:59.307085 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-193985f0-9557-4cca-b4dc-666ddd2e6edc tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:51:59.307687 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-193985f0-9557-4cca-b4dc-666ddd2e6edc tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:51:59.314557 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-193985f0-9557-4cca-b4dc-666ddd2e6edc tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:59.315070 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-193985f0-9557-4cca-b4dc-666ddd2e6edc tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:59.315507 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-193985f0-9557-4cca-b4dc-666ddd2e6edc tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:59.316193 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-193985f0-9557-4cca-b4dc-666ddd2e6edc tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:51:59.316632 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-193985f0-9557-4cca-b4dc-666ddd2e6edc tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:51:59.317056 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-193985f0-9557-4cca-b4dc-666ddd2e6edc tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:51:59.464498 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-193985f0-9557-4cca-b4dc-666ddd2e6edc tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:51:59.473293 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-193985f0-9557-4cca-b4dc-666ddd2e6edc tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1755 microversion: 2.1 time: 0.170191 Oct 24 08:51:59.473893 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 268/535] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:51:59 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:00.500892 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-8cb526c6-3017-4bc0-a438-4ee2af738985 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:00.501863 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-8cb526c6-3017-4bc0-a438-4ee2af738985 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:00.512754 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8cb526c6-3017-4bc0-a438-4ee2af738985 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:00.513543 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8cb526c6-3017-4bc0-a438-4ee2af738985 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:00.514239 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8cb526c6-3017-4bc0-a438-4ee2af738985 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:00.515438 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8cb526c6-3017-4bc0-a438-4ee2af738985 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:00.516180 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8cb526c6-3017-4bc0-a438-4ee2af738985 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:00.516870 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8cb526c6-3017-4bc0-a438-4ee2af738985 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:00.662007 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-8cb526c6-3017-4bc0-a438-4ee2af738985 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:00.670540 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-8cb526c6-3017-4bc0-a438-4ee2af738985 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1755 microversion: 2.1 time: 0.176276 Oct 24 08:52:00.671103 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 268/536] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:00 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:01.697509 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-3179816b-93de-4858-8289-5636a0b4037b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:01.698452 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-3179816b-93de-4858-8289-5636a0b4037b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:01.705884 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3179816b-93de-4858-8289-5636a0b4037b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:01.706364 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3179816b-93de-4858-8289-5636a0b4037b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:01.706821 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3179816b-93de-4858-8289-5636a0b4037b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:01.707505 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3179816b-93de-4858-8289-5636a0b4037b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:01.707950 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3179816b-93de-4858-8289-5636a0b4037b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:01.708365 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3179816b-93de-4858-8289-5636a0b4037b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:01.853132 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-3179816b-93de-4858-8289-5636a0b4037b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:01.862371 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-3179816b-93de-4858-8289-5636a0b4037b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1755 microversion: 2.1 time: 0.171444 Oct 24 08:52:01.863006 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 269/537] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:01 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:02.887420 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-a50045a0-196e-4010-8da5-2451d1595231 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:02.888133 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-a50045a0-196e-4010-8da5-2451d1595231 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:02.895989 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a50045a0-196e-4010-8da5-2451d1595231 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:02.896549 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a50045a0-196e-4010-8da5-2451d1595231 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:02.897053 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a50045a0-196e-4010-8da5-2451d1595231 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:02.897845 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a50045a0-196e-4010-8da5-2451d1595231 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:02.898364 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a50045a0-196e-4010-8da5-2451d1595231 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:02.898881 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a50045a0-196e-4010-8da5-2451d1595231 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:03.042591 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-a50045a0-196e-4010-8da5-2451d1595231 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:03.051659 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-a50045a0-196e-4010-8da5-2451d1595231 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1755 microversion: 2.1 time: 0.168926 Oct 24 08:52:03.052230 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 269/538] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:02 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:03.952443 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-b1e611c3-b566-446c-8716-88076ff96471 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:03.953054 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-b1e611c3-b566-446c-8716-88076ff96471 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:03.959489 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b1e611c3-b566-446c-8716-88076ff96471 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:03.959972 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b1e611c3-b566-446c-8716-88076ff96471 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:03.960413 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b1e611c3-b566-446c-8716-88076ff96471 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:03.961093 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b1e611c3-b566-446c-8716-88076ff96471 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:03.961542 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b1e611c3-b566-446c-8716-88076ff96471 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:03.961960 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b1e611c3-b566-446c-8716-88076ff96471 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:04.075074 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-988b9075-2434-45b1-9e67-f84c0f5d38d5 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:04.075691 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-988b9075-2434-45b1-9e67-f84c0f5d38d5 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:04.082221 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-988b9075-2434-45b1-9e67-f84c0f5d38d5 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:04.082706 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-988b9075-2434-45b1-9e67-f84c0f5d38d5 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:04.083161 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-988b9075-2434-45b1-9e67-f84c0f5d38d5 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:04.083846 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-988b9075-2434-45b1-9e67-f84c0f5d38d5 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:04.084291 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-988b9075-2434-45b1-9e67-f84c0f5d38d5 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:04.084707 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-988b9075-2434-45b1-9e67-f84c0f5d38d5 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:04.092049 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.objects.instance [None req-b1e611c3-b566-446c-8716-88076ff96471 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lazy-loading 'services' on Instance uuid 031a03be-3f3b-46dd-944c-6e68a9d8b09a {{(pid=125165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:52:04.126988 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:04.209904 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-b1e611c3-b566-446c-8716-88076ff96471 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "DELETE /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a/os-volume_attachments/239128c7-7519-4bfc-b100-b0bcd9d46f48" status: 202 len: 0 microversion: 2.1 time: 0.264284 Oct 24 08:52:04.210603 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 270/539] 10.222.0.26 () {58 vars in 1416 bytes} [Mon Oct 24 08:52:03 2022] DELETE /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a/os-volume_attachments/239128c7-7519-4bfc-b100-b0bcd9d46f48 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:52:04.236573 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-988b9075-2434-45b1-9e67-f84c0f5d38d5 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:04.245476 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-988b9075-2434-45b1-9e67-f84c0f5d38d5 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1758 microversion: 2.1 time: 0.174211 Oct 24 08:52:04.246064 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 270/540] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:04 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:05.345135 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-119141cb-b1aa-4f19-8b20-70a4aace697a tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:05.351589 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-119141cb-b1aa-4f19-8b20-70a4aace697a tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:05.352069 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-119141cb-b1aa-4f19-8b20-70a4aace697a tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:05.352508 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-119141cb-b1aa-4f19-8b20-70a4aace697a tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:05.374437 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-119141cb-b1aa-4f19-8b20-70a4aace697a tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Going to try to stop instance {{(pid=125165) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 24 08:52:05.419516 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-119141cb-b1aa-4f19-8b20-70a4aace697a tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "POST /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a/action" status: 202 len: 0 microversion: 2.1 time: 0.078578 Oct 24 08:52:05.420109 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 271/541] 10.222.0.26 () {60 vars in 1278 bytes} [Mon Oct 24 08:52:05 2022] POST /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:52:05.428936 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-0c423664-bd06-4984-8a25-16e854d5d7fa tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:05.429579 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-0c423664-bd06-4984-8a25-16e854d5d7fa tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:05.436255 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0c423664-bd06-4984-8a25-16e854d5d7fa tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:05.436767 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0c423664-bd06-4984-8a25-16e854d5d7fa tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:05.437749 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0c423664-bd06-4984-8a25-16e854d5d7fa tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:05.438442 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0c423664-bd06-4984-8a25-16e854d5d7fa tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:05.439099 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0c423664-bd06-4984-8a25-16e854d5d7fa tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:05.439528 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0c423664-bd06-4984-8a25-16e854d5d7fa tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:05.571974 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-0c423664-bd06-4984-8a25-16e854d5d7fa tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:05.579992 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-0c423664-bd06-4984-8a25-16e854d5d7fa tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1679 microversion: 2.1 time: 0.155015 Oct 24 08:52:05.580534 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 271/542] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:05 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:52:06.613267 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-7fb50b74-1429-46eb-bb54-13d44dafc26d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:06.614415 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-7fb50b74-1429-46eb-bb54-13d44dafc26d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:06.624989 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7fb50b74-1429-46eb-bb54-13d44dafc26d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:06.625509 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7fb50b74-1429-46eb-bb54-13d44dafc26d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:06.625940 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7fb50b74-1429-46eb-bb54-13d44dafc26d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:06.626625 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7fb50b74-1429-46eb-bb54-13d44dafc26d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:06.627114 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7fb50b74-1429-46eb-bb54-13d44dafc26d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:06.627534 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7fb50b74-1429-46eb-bb54-13d44dafc26d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:06.757467 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-7fb50b74-1429-46eb-bb54-13d44dafc26d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:06.765755 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-7fb50b74-1429-46eb-bb54-13d44dafc26d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1679 microversion: 2.1 time: 0.159503 Oct 24 08:52:06.766295 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 272/543] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:06 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:07.803840 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-f77311c5-b49d-4e93-a846-faeb9005e91a tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:07.804695 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-f77311c5-b49d-4e93-a846-faeb9005e91a tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:07.814041 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f77311c5-b49d-4e93-a846-faeb9005e91a tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:07.814518 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f77311c5-b49d-4e93-a846-faeb9005e91a tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:07.814989 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f77311c5-b49d-4e93-a846-faeb9005e91a tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:07.815690 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f77311c5-b49d-4e93-a846-faeb9005e91a tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:07.816139 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f77311c5-b49d-4e93-a846-faeb9005e91a tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:07.816559 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f77311c5-b49d-4e93-a846-faeb9005e91a tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:07.961317 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-f77311c5-b49d-4e93-a846-faeb9005e91a tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:07.969544 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-f77311c5-b49d-4e93-a846-faeb9005e91a tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1679 microversion: 2.1 time: 0.174901 Oct 24 08:52:07.970128 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 272/544] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:07 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:08.996085 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-925eac06-1ba9-414a-9efc-ef1f0c685912 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:08.997073 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-925eac06-1ba9-414a-9efc-ef1f0c685912 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:09.007245 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-925eac06-1ba9-414a-9efc-ef1f0c685912 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:09.008091 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-925eac06-1ba9-414a-9efc-ef1f0c685912 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:09.008807 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-925eac06-1ba9-414a-9efc-ef1f0c685912 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:09.009965 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-925eac06-1ba9-414a-9efc-ef1f0c685912 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:09.010942 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-925eac06-1ba9-414a-9efc-ef1f0c685912 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:09.011637 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-925eac06-1ba9-414a-9efc-ef1f0c685912 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:09.141499 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-925eac06-1ba9-414a-9efc-ef1f0c685912 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:09.149544 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-925eac06-1ba9-414a-9efc-ef1f0c685912 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1679 microversion: 2.1 time: 0.160047 Oct 24 08:52:09.150104 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 273/545] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:08 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:10.177218 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-2702d8ac-8bde-4cd4-a268-fcbdd1b2f1f5 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:10.178100 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-2702d8ac-8bde-4cd4-a268-fcbdd1b2f1f5 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:10.187905 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2702d8ac-8bde-4cd4-a268-fcbdd1b2f1f5 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:10.188394 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2702d8ac-8bde-4cd4-a268-fcbdd1b2f1f5 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:10.188818 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2702d8ac-8bde-4cd4-a268-fcbdd1b2f1f5 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:10.189496 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2702d8ac-8bde-4cd4-a268-fcbdd1b2f1f5 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:10.189942 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2702d8ac-8bde-4cd4-a268-fcbdd1b2f1f5 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:10.190353 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2702d8ac-8bde-4cd4-a268-fcbdd1b2f1f5 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:10.328249 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-2702d8ac-8bde-4cd4-a268-fcbdd1b2f1f5 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:10.336402 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-2702d8ac-8bde-4cd4-a268-fcbdd1b2f1f5 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1679 microversion: 2.1 time: 0.165699 Oct 24 08:52:10.337272 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 273/546] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:10 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:11.364009 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-0391ff85-4413-4569-abbd-6be4fd1f93ee tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:11.365004 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-0391ff85-4413-4569-abbd-6be4fd1f93ee tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:11.375383 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0391ff85-4413-4569-abbd-6be4fd1f93ee tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:11.376268 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0391ff85-4413-4569-abbd-6be4fd1f93ee tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:11.376949 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0391ff85-4413-4569-abbd-6be4fd1f93ee tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:11.378088 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0391ff85-4413-4569-abbd-6be4fd1f93ee tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:11.379248 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0391ff85-4413-4569-abbd-6be4fd1f93ee tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:11.379949 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0391ff85-4413-4569-abbd-6be4fd1f93ee tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:11.516328 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-0391ff85-4413-4569-abbd-6be4fd1f93ee tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:11.524454 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-0391ff85-4413-4569-abbd-6be4fd1f93ee tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1679 microversion: 2.1 time: 0.167163 Oct 24 08:52:11.525030 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 274/547] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:11 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:12.553022 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-4ba57d91-e053-46bc-af56-f44a953d8d59 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:12.553869 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-4ba57d91-e053-46bc-af56-f44a953d8d59 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:12.563833 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4ba57d91-e053-46bc-af56-f44a953d8d59 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:12.564312 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4ba57d91-e053-46bc-af56-f44a953d8d59 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:12.564740 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4ba57d91-e053-46bc-af56-f44a953d8d59 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:12.565421 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4ba57d91-e053-46bc-af56-f44a953d8d59 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:12.565864 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4ba57d91-e053-46bc-af56-f44a953d8d59 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:12.566281 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4ba57d91-e053-46bc-af56-f44a953d8d59 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:12.701639 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-4ba57d91-e053-46bc-af56-f44a953d8d59 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:12.709762 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-4ba57d91-e053-46bc-af56-f44a953d8d59 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1679 microversion: 2.1 time: 0.163681 Oct 24 08:52:12.710331 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 274/548] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:12 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:13.737860 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-060423cd-7569-4902-a198-248a940cd3de tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:13.738900 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-060423cd-7569-4902-a198-248a940cd3de tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:13.748942 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-060423cd-7569-4902-a198-248a940cd3de tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:13.749721 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-060423cd-7569-4902-a198-248a940cd3de tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:13.750612 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-060423cd-7569-4902-a198-248a940cd3de tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:13.751797 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-060423cd-7569-4902-a198-248a940cd3de tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:13.752552 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-060423cd-7569-4902-a198-248a940cd3de tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:13.753251 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-060423cd-7569-4902-a198-248a940cd3de tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:13.899637 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-060423cd-7569-4902-a198-248a940cd3de tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:13.907504 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-060423cd-7569-4902-a198-248a940cd3de tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1679 microversion: 2.1 time: 0.176377 Oct 24 08:52:13.908042 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 275/549] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:13 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:14.940419 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-bcd35deb-289e-4c93-8fca-2717c5960ec6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:14.941063 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-bcd35deb-289e-4c93-8fca-2717c5960ec6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:14.948356 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bcd35deb-289e-4c93-8fca-2717c5960ec6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:14.948862 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bcd35deb-289e-4c93-8fca-2717c5960ec6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:14.949321 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bcd35deb-289e-4c93-8fca-2717c5960ec6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:14.950038 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bcd35deb-289e-4c93-8fca-2717c5960ec6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:14.950508 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bcd35deb-289e-4c93-8fca-2717c5960ec6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:14.950987 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bcd35deb-289e-4c93-8fca-2717c5960ec6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:15.090767 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-bcd35deb-289e-4c93-8fca-2717c5960ec6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:15.098844 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-bcd35deb-289e-4c93-8fca-2717c5960ec6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1679 microversion: 2.1 time: 0.162565 Oct 24 08:52:15.099407 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 275/550] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:14 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:16.125938 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-1f9323f6-5672-404f-8109-e343f4aad1b6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:16.126896 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-1f9323f6-5672-404f-8109-e343f4aad1b6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:16.133082 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1f9323f6-5672-404f-8109-e343f4aad1b6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:16.133560 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1f9323f6-5672-404f-8109-e343f4aad1b6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:16.133985 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1f9323f6-5672-404f-8109-e343f4aad1b6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:16.134658 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1f9323f6-5672-404f-8109-e343f4aad1b6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:16.135139 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1f9323f6-5672-404f-8109-e343f4aad1b6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:16.135563 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1f9323f6-5672-404f-8109-e343f4aad1b6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:16.506169 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-1f9323f6-5672-404f-8109-e343f4aad1b6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:16.513959 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-1f9323f6-5672-404f-8109-e343f4aad1b6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1679 microversion: 2.1 time: 0.395042 Oct 24 08:52:16.514530 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 276/551] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:16 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1679 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:17.540721 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-28cc062c-6b48-41ee-a062-95fdf43f16c4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:17.541558 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-28cc062c-6b48-41ee-a062-95fdf43f16c4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:17.553171 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-28cc062c-6b48-41ee-a062-95fdf43f16c4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:17.554001 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-28cc062c-6b48-41ee-a062-95fdf43f16c4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:17.554680 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-28cc062c-6b48-41ee-a062-95fdf43f16c4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:17.555822 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-28cc062c-6b48-41ee-a062-95fdf43f16c4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:17.556566 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-28cc062c-6b48-41ee-a062-95fdf43f16c4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:17.557262 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-28cc062c-6b48-41ee-a062-95fdf43f16c4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:17.696284 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-28cc062c-6b48-41ee-a062-95fdf43f16c4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:17.704674 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-28cc062c-6b48-41ee-a062-95fdf43f16c4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1679 microversion: 2.1 time: 0.170660 Oct 24 08:52:17.705249 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 276/552] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:17 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:18.732044 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-a2714beb-d6ba-410b-b770-f11e50c65866 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:18.733033 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-a2714beb-d6ba-410b-b770-f11e50c65866 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:18.736150 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_api:SELECT=38 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:18.741463 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a2714beb-d6ba-410b-b770-f11e50c65866 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:18.741942 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a2714beb-d6ba-410b-b770-f11e50c65866 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:18.742365 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a2714beb-d6ba-410b-b770-f11e50c65866 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:18.743067 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a2714beb-d6ba-410b-b770-f11e50c65866 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:18.743521 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a2714beb-d6ba-410b-b770-f11e50c65866 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:18.743933 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a2714beb-d6ba-410b-b770-f11e50c65866 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:18.871634 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a2714beb-d6ba-410b-b770-f11e50c65866 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:18.880072 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-a2714beb-d6ba-410b-b770-f11e50c65866 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1679 microversion: 2.1 time: 0.154574 Oct 24 08:52:18.880631 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 277/553] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:18 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:19.907225 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-fd3601ad-7af7-4860-a749-396232252b9d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:19.908291 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-fd3601ad-7af7-4860-a749-396232252b9d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:19.915832 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-fd3601ad-7af7-4860-a749-396232252b9d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:19.916368 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-fd3601ad-7af7-4860-a749-396232252b9d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:19.916876 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-fd3601ad-7af7-4860-a749-396232252b9d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:19.917594 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-fd3601ad-7af7-4860-a749-396232252b9d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:19.918092 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-fd3601ad-7af7-4860-a749-396232252b9d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:19.918948 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-fd3601ad-7af7-4860-a749-396232252b9d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:20.050869 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-fd3601ad-7af7-4860-a749-396232252b9d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:20.059160 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-fd3601ad-7af7-4860-a749-396232252b9d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1679 microversion: 2.1 time: 0.158453 Oct 24 08:52:20.059726 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 277/554] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:19 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:21.086506 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-2710c1a4-ac59-4627-b784-838589e617a4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:21.087482 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-2710c1a4-ac59-4627-b784-838589e617a4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:21.097777 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2710c1a4-ac59-4627-b784-838589e617a4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:21.098581 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2710c1a4-ac59-4627-b784-838589e617a4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:21.099358 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2710c1a4-ac59-4627-b784-838589e617a4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:21.100505 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2710c1a4-ac59-4627-b784-838589e617a4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:21.101251 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2710c1a4-ac59-4627-b784-838589e617a4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:21.101914 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2710c1a4-ac59-4627-b784-838589e617a4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:21.236714 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-2710c1a4-ac59-4627-b784-838589e617a4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:21.244821 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-2710c1a4-ac59-4627-b784-838589e617a4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1656 microversion: 2.1 time: 0.164991 Oct 24 08:52:21.245395 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 278/555] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:21 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1656 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:21.269445 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-72173426-8089-4bc3-8bee-35fb0e674ea1 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:21.271979 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_api:SELECT=34 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:21.277321 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-72173426-8089-4bc3-8bee-35fb0e674ea1 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:21.277802 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-72173426-8089-4bc3-8bee-35fb0e674ea1 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:21.278272 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-72173426-8089-4bc3-8bee-35fb0e674ea1 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:21.336562 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-72173426-8089-4bc3-8bee-35fb0e674ea1 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Going to try to start instance {{(pid=125164) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 24 08:52:21.371195 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:21.382521 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-72173426-8089-4bc3-8bee-35fb0e674ea1 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "POST /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a/action" status: 202 len: 0 microversion: 2.1 time: 0.116930 Oct 24 08:52:21.383210 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 278/556] 10.222.0.26 () {60 vars in 1278 bytes} [Mon Oct 24 08:52:21 2022] POST /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:52:21.391212 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-d5a4dd29-07b9-4569-9a4f-1827fa2f88ad tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:21.391818 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-d5a4dd29-07b9-4569-9a4f-1827fa2f88ad tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:21.397940 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d5a4dd29-07b9-4569-9a4f-1827fa2f88ad tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:21.398409 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d5a4dd29-07b9-4569-9a4f-1827fa2f88ad tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:21.398981 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d5a4dd29-07b9-4569-9a4f-1827fa2f88ad tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:21.399665 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d5a4dd29-07b9-4569-9a4f-1827fa2f88ad tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:21.400109 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d5a4dd29-07b9-4569-9a4f-1827fa2f88ad tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:21.400534 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d5a4dd29-07b9-4569-9a4f-1827fa2f88ad tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:21.529407 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-d5a4dd29-07b9-4569-9a4f-1827fa2f88ad tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:21.537594 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-d5a4dd29-07b9-4569-9a4f-1827fa2f88ad tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1665 microversion: 2.1 time: 0.150104 Oct 24 08:52:21.538384 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 279/557] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:21 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1665 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:22.417979 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-341cca91-c49b-4b11-81da-b68b5fb15cde tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ff9a9f1-f85f-4d3f-912b-6497606a6b26"}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:22.422450 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-341cca91-c49b-4b11-81da-b68b5fb15cde tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:22.429940 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-341cca91-c49b-4b11-81da-b68b5fb15cde tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:22.430417 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-341cca91-c49b-4b11-81da-b68b5fb15cde tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:22.430890 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-341cca91-c49b-4b11-81da-b68b5fb15cde tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:22.431571 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-341cca91-c49b-4b11-81da-b68b5fb15cde tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:22.432022 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-341cca91-c49b-4b11-81da-b68b5fb15cde tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:22.432439 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-341cca91-c49b-4b11-81da-b68b5fb15cde tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:22.564889 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-8435991b-7773-43d2-927b-5d0224408d8c tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:22.565679 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-8435991b-7773-43d2-927b-5d0224408d8c tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:22.575173 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8435991b-7773-43d2-927b-5d0224408d8c tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:22.575911 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8435991b-7773-43d2-927b-5d0224408d8c tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:22.576578 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8435991b-7773-43d2-927b-5d0224408d8c tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:22.577617 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8435991b-7773-43d2-927b-5d0224408d8c tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:22.578316 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8435991b-7773-43d2-927b-5d0224408d8c tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:22.579174 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8435991b-7773-43d2-927b-5d0224408d8c tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:22.715942 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-8435991b-7773-43d2-927b-5d0224408d8c tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:22.723872 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-8435991b-7773-43d2-927b-5d0224408d8c tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1665 microversion: 2.1 time: 0.165310 Oct 24 08:52:22.724457 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 280/558] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:22 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1665 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:23.324086 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-341cca91-c49b-4b11-81da-b68b5fb15cde tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "POST /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.913867 Oct 24 08:52:23.325003 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 279/559] 10.222.0.26 () {60 vars in 1323 bytes} [Mon Oct 24 08:52:22 2022] POST /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74/os-volume_attachments => generated 194 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:52:23.746880 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-90153d00-8328-4ca6-af4c-15d6a305fd8b tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:23.747501 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-90153d00-8328-4ca6-af4c-15d6a305fd8b tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:23.753960 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-90153d00-8328-4ca6-af4c-15d6a305fd8b tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:23.754391 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-90153d00-8328-4ca6-af4c-15d6a305fd8b tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:23.754864 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-90153d00-8328-4ca6-af4c-15d6a305fd8b tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:23.755557 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-90153d00-8328-4ca6-af4c-15d6a305fd8b tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:23.756008 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-90153d00-8328-4ca6-af4c-15d6a305fd8b tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:23.756431 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-90153d00-8328-4ca6-af4c-15d6a305fd8b tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:23.895850 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-90153d00-8328-4ca6-af4c-15d6a305fd8b tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:23.904087 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-90153d00-8328-4ca6-af4c-15d6a305fd8b tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1669 microversion: 2.1 time: 0.161250 Oct 24 08:52:23.904662 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 281/560] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:23 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1669 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:25.586871 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-6f297a38-024b-44e4-9429-f39f5c2f1df8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:25.589266 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-6f297a38-024b-44e4-9429-f39f5c2f1df8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:25.596090 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6f297a38-024b-44e4-9429-f39f5c2f1df8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:25.596566 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6f297a38-024b-44e4-9429-f39f5c2f1df8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:25.596997 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6f297a38-024b-44e4-9429-f39f5c2f1df8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:25.597675 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6f297a38-024b-44e4-9429-f39f5c2f1df8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:25.598264 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6f297a38-024b-44e4-9429-f39f5c2f1df8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:25.598658 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6f297a38-024b-44e4-9429-f39f5c2f1df8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:25.631695 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.objects.instance [None req-6f297a38-024b-44e4-9429-f39f5c2f1df8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lazy-loading 'flavor' on Instance uuid f891147d-0b78-40f9-a17c-e1c9dbbc9f74 {{(pid=125164) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:52:25.764448 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-6f297a38-024b-44e4-9429-f39f5c2f1df8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "POST /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74/action" status: 200 len: 32 microversion: 2.1 time: 0.182249 Oct 24 08:52:25.765262 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 280/561] 10.222.0.26 () {60 vars in 1278 bytes} [Mon Oct 24 08:52:25 2022] POST /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74/action => generated 32 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:52:25.775151 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-29ba6506-dd0c-4607-a15e-631f88c07330 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:25.775762 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-29ba6506-dd0c-4607-a15e-631f88c07330 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:25.782332 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-29ba6506-dd0c-4607-a15e-631f88c07330 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:25.782912 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-29ba6506-dd0c-4607-a15e-631f88c07330 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:25.783389 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-29ba6506-dd0c-4607-a15e-631f88c07330 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:25.784088 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-29ba6506-dd0c-4607-a15e-631f88c07330 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:25.784792 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-29ba6506-dd0c-4607-a15e-631f88c07330 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:25.785207 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-29ba6506-dd0c-4607-a15e-631f88c07330 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:25.998272 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-29ba6506-dd0c-4607-a15e-631f88c07330 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:26.006949 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-29ba6506-dd0c-4607-a15e-631f88c07330 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1735 microversion: 2.1 time: 0.235759 Oct 24 08:52:26.007553 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 282/562] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:25 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1735 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:52:27.035366 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-54544114-f4f5-41d0-a21a-732cf7c12e9d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:27.036297 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-54544114-f4f5-41d0-a21a-732cf7c12e9d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:27.043026 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-54544114-f4f5-41d0-a21a-732cf7c12e9d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:27.043838 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-54544114-f4f5-41d0-a21a-732cf7c12e9d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:27.044303 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-54544114-f4f5-41d0-a21a-732cf7c12e9d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:27.044981 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-54544114-f4f5-41d0-a21a-732cf7c12e9d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:27.045425 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-54544114-f4f5-41d0-a21a-732cf7c12e9d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:27.045836 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-54544114-f4f5-41d0-a21a-732cf7c12e9d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:27.176883 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-54544114-f4f5-41d0-a21a-732cf7c12e9d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:27.185449 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-54544114-f4f5-41d0-a21a-732cf7c12e9d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1735 microversion: 2.1 time: 0.157931 Oct 24 08:52:27.186012 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 281/563] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:27 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:27.836367 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-50de4f7a-b5f0-421f-998a-8a2e81f9d8c8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:27.837238 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-50de4f7a-b5f0-421f-998a-8a2e81f9d8c8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 880d7b45-efa0-4aec-9342-b84795db3c74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:27.847356 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-50de4f7a-b5f0-421f-998a-8a2e81f9d8c8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:27.848125 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-50de4f7a-b5f0-421f-998a-8a2e81f9d8c8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:27.848707 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-50de4f7a-b5f0-421f-998a-8a2e81f9d8c8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:27.849399 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-50de4f7a-b5f0-421f-998a-8a2e81f9d8c8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:27.849838 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-50de4f7a-b5f0-421f-998a-8a2e81f9d8c8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:27.850255 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-50de4f7a-b5f0-421f-998a-8a2e81f9d8c8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:27.873339 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-50de4f7a-b5f0-421f-998a-8a2e81f9d8c8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74/ips" status: 200 len: 150 microversion: 2.1 time: 0.043513 Oct 24 08:52:27.873891 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 283/564] 10.222.0.26 () {58 vars in 1248 bytes} [Mon Oct 24 08:52:27 2022] GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:52:27.886172 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-e6538b74-9657-46b8-8fb1-be4d91896a76 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2eaf1852-e435-4848-8e43-a496b4d5ceaa"}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:27.888679 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-e6538b74-9657-46b8-8fb1-be4d91896a76 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 880d7b45-efa0-4aec-9342-b84795db3c74] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:27.895297 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e6538b74-9657-46b8-8fb1-be4d91896a76 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:27.895786 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e6538b74-9657-46b8-8fb1-be4d91896a76 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:27.896224 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e6538b74-9657-46b8-8fb1-be4d91896a76 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:27.896912 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e6538b74-9657-46b8-8fb1-be4d91896a76 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:27.897365 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e6538b74-9657-46b8-8fb1-be4d91896a76 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:27.897788 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e6538b74-9657-46b8-8fb1-be4d91896a76 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:27.983703 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.wsgi [None req-e6538b74-9657-46b8-8fb1-be4d91896a76 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] HTTP exception thrown: Invalid volume: volume 2eaf1852-e435-4848-8e43-a496b4d5ceaa is already attached to instances: f6890641-4753-4fb7-86a4-fb5782b1b5b1 Oct 24 08:52:27.985438 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-e6538b74-9657-46b8-8fb1-be4d91896a76 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Request method failure captured: Oct 24 08:52:27.985438 dv-cinder-master-3-smb devstack@n-api.service[125164]: request: POST /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74/os-volume_attachments HTTP/1.1 Oct 24 08:52:27.985438 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept: application/json Oct 24 08:52:27.985438 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept-Encoding: identity Oct 24 08:52:27.985438 dv-cinder-master-3-smb devstack@n-api.service[125164]: Connection: close Oct 24 08:52:27.985438 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Length: 74 Oct 24 08:52:27.985438 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Type: application/json Oct 24 08:52:27.985438 dv-cinder-master-3-smb devstack@n-api.service[125164]: Host: 10.222.0.26 Oct 24 08:52:27.985438 dv-cinder-master-3-smb devstack@n-api.service[125164]: Openstack-System-Scope: None Oct 24 08:52:27.985438 dv-cinder-master-3-smb devstack@n-api.service[125164]: User-Agent: python-urllib3/1.26.12 Oct 24 08:52:27.985438 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Auth-Token: gAAAAABjVlE2u8htP-0ukfebxjPQ_Tv08AEgRkqfcKErVq7KuTRTMT0ulC9K9eGWmc0J9Q6UTd3t0f_FhG9s34JNa-sHLE0_eBaC2GRhGdxZJM_viMU6wO-8X3T5-_M7hKYRa28fguCQkp2kM0S7f5w35MMqRh0sMsrU0PYXCVdXzPLgYLOBkKQ Oct 24 08:52:27.985438 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Id: None Oct 24 08:52:27.985438 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Name: None Oct 24 08:52:27.985438 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Identity-Status: Confirmed Oct 24 08:52:27.985438 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Is-Admin-Project: True Oct 24 08:52:27.985438 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Id: default Oct 24 08:52:27.985438 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Name: Default Oct 24 08:52:27.985438 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Id: 02be1b30677f400788b35b03938e44e5 Oct 24 08:52:27.985438 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Name: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:52:27.985438 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Role: reader,member Oct 24 08:52:27.985438 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Roles: reader,member Oct 24 08:52:27.986932 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_02be1b30677f400788b35b03938e44e5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/02be1b30677f400788b35b03938e44e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02be1b30677f400788b35b03938e44e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02be1b30677f400788b35b03938e44e5"}]}] Oct 24 08:52:27.986932 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:52:27.986932 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Id: 02be1b30677f400788b35b03938e44e5 Oct 24 08:52:27.986932 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:52:27.986932 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User: tempest-AttachVolumeNegativeTest-1868225476-project Oct 24 08:52:27.986932 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Id: default Oct 24 08:52:27.986932 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Name: Default Oct 24 08:52:27.986932 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Id: 712e5cf4cc004918817ab1802b9c69d6 Oct 24 08:52:27.986932 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Name: tempest-AttachVolumeNegativeTest-1868225476-project Oct 24 08:52:27.986932 dv-cinder-master-3-smb devstack@n-api.service[125164]: Oct 24 08:52:27.986932 dv-cinder-master-3-smb devstack@n-api.service[125164]: {"volumeAttachment": {"volumeId": "2eaf1852-e435-4848-8e43-a496b4d5ceaa"}} Oct 24 08:52:27.986932 dv-cinder-master-3-smb devstack@n-api.service[125164]: method: > Oct 24 08:52:27.987896 dv-cinder-master-3-smb devstack@n-api.service[125164]: exception: Invalid volume: volume 2eaf1852-e435-4848-8e43-a496b4d5ceaa is already attached to instances: f6890641-4753-4fb7-86a4-fb5782b1b5b1 Oct 24 08:52:27.987896 dv-cinder-master-3-smb devstack@n-api.service[125164]: action_args: {'server_id': '880d7b45-efa0-4aec-9342-b84795db3c74', 'body': {'volumeAttachment': {'volumeId': '2eaf1852-e435-4848-8e43-a496b4d5ceaa'}}} Oct 24 08:52:27.987896 dv-cinder-master-3-smb devstack@n-api.service[125164]: {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:52:27.987896 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:27.987896 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 24 08:52:27.987896 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 24 08:52:27.987896 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 08:52:27.987896 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 08:52:27.987896 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 24 08:52:27.987896 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 08:52:27.987896 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 24 08:52:27.987896 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 24 08:52:27.987896 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 24 08:52:27.987896 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 24 08:52:27.987896 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2eaf1852-e435-4848-8e43-a496b4d5ceaa is already attached to instances: f6890641-4753-4fb7-86a4-fb5782b1b5b1 Oct 24 08:52:27.987896 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:52:27.987896 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:27.987896 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:52:27.987896 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:27.989457 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:27.989457 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:27.989457 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:52:27.989457 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:52:27.989457 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:52:27.989457 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:52:27.989457 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:52:27.989457 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:52:27.989457 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:52:27.989457 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:52:27.989457 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:52:27.989457 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:52:27.989457 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 24 08:52:27.989457 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 24 08:52:27.989457 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2eaf1852-e435-4848-8e43-a496b4d5ceaa is already attached to instances: f6890641-4753-4fb7-86a4-fb5782b1b5b1 Oct 24 08:52:27.989457 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:52:27.989457 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:27.989457 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:52:27.989457 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:27.989457 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:27.991016 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:27.991016 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:52:27.991016 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:52:27.991016 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2eaf1852-e435-4848-8e43-a496b4d5ceaa is already attached to instances: f6890641-4753-4fb7-86a4-fb5782b1b5b1 Oct 24 08:52:27.991016 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:52:27.991016 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-e6538b74-9657-46b8-8fb1-be4d91896a76 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Returning 400 to user: Invalid volume: volume 2eaf1852-e435-4848-8e43-a496b4d5ceaa is already attached to instances: f6890641-4753-4fb7-86a4-fb5782b1b5b1 {{(pid=125164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:52:27.991016 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-e6538b74-9657-46b8-8fb1-be4d91896a76 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "POST /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104946 Oct 24 08:52:27.991016 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 282/565] 10.222.0.26 () {60 vars in 1323 bytes} [Mon Oct 24 08:52:27 2022] POST /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 24 08:52:27.996897 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-a1b6c8a0-b953-45d9-b0a7-b70c0f812f32 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:27.997399 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-a1b6c8a0-b953-45d9-b0a7-b70c0f812f32 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 880d7b45-efa0-4aec-9342-b84795db3c74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:28.003419 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a1b6c8a0-b953-45d9-b0a7-b70c0f812f32 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:28.003888 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a1b6c8a0-b953-45d9-b0a7-b70c0f812f32 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:28.004345 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a1b6c8a0-b953-45d9-b0a7-b70c0f812f32 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:28.005022 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a1b6c8a0-b953-45d9-b0a7-b70c0f812f32 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:28.005454 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a1b6c8a0-b953-45d9-b0a7-b70c0f812f32 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:28.005869 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a1b6c8a0-b953-45d9-b0a7-b70c0f812f32 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:28.029676 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-a1b6c8a0-b953-45d9-b0a7-b70c0f812f32 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 880d7b45-efa0-4aec-9342-b84795db3c74] Going to try to terminate instance {{(pid=125165) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:52:28.085505 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:28.114740 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-a1b6c8a0-b953-45d9-b0a7-b70c0f812f32 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "DELETE /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74" status: 204 len: 0 microversion: 2.1 time: 0.121388 Oct 24 08:52:28.115324 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 284/566] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Oct 24 08:52:27 2022] DELETE /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:52:28.124906 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-6f06f8eb-86bf-4b80-9311-166def06f233 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:28.125754 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-6f06f8eb-86bf-4b80-9311-166def06f233 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 880d7b45-efa0-4aec-9342-b84795db3c74] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:28.132957 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6f06f8eb-86bf-4b80-9311-166def06f233 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:28.133445 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6f06f8eb-86bf-4b80-9311-166def06f233 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:28.133881 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6f06f8eb-86bf-4b80-9311-166def06f233 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:28.134571 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6f06f8eb-86bf-4b80-9311-166def06f233 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:28.135059 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6f06f8eb-86bf-4b80-9311-166def06f233 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:28.135487 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6f06f8eb-86bf-4b80-9311-166def06f233 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:28.209306 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-9be38e02-2811-41b4-bffc-78cd272a0ac9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:28.210031 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-9be38e02-2811-41b4-bffc-78cd272a0ac9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:28.216104 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9be38e02-2811-41b4-bffc-78cd272a0ac9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:28.216600 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9be38e02-2811-41b4-bffc-78cd272a0ac9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:28.217082 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9be38e02-2811-41b4-bffc-78cd272a0ac9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:28.217812 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9be38e02-2811-41b4-bffc-78cd272a0ac9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:28.218235 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9be38e02-2811-41b4-bffc-78cd272a0ac9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:28.218655 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-9be38e02-2811-41b4-bffc-78cd272a0ac9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:28.276609 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-6f06f8eb-86bf-4b80-9311-166def06f233 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:28.284991 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-6f06f8eb-86bf-4b80-9311-166def06f233 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74" status: 200 len: 1680 microversion: 2.1 time: 0.164538 Oct 24 08:52:28.285403 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 283/567] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:28 2022] GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:52:28.361161 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-9be38e02-2811-41b4-bffc-78cd272a0ac9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:28.373743 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-9be38e02-2811-41b4-bffc-78cd272a0ac9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1735 microversion: 2.1 time: 0.168566 Oct 24 08:52:28.374364 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 285/568] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:28 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:29.308937 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-bf757964-bf26-4cbd-bd4a-3e2252801a42 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:29.309554 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-bf757964-bf26-4cbd-bd4a-3e2252801a42 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 880d7b45-efa0-4aec-9342-b84795db3c74] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:29.316457 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bf757964-bf26-4cbd-bd4a-3e2252801a42 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:29.316941 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bf757964-bf26-4cbd-bd4a-3e2252801a42 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:29.317375 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bf757964-bf26-4cbd-bd4a-3e2252801a42 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:29.318096 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bf757964-bf26-4cbd-bd4a-3e2252801a42 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:29.318538 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bf757964-bf26-4cbd-bd4a-3e2252801a42 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:29.318997 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bf757964-bf26-4cbd-bd4a-3e2252801a42 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:29.399175 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-b555b60a-bafd-4d3b-88c9-8108496b4171 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:29.399809 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-b555b60a-bafd-4d3b-88c9-8108496b4171 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:29.406280 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b555b60a-bafd-4d3b-88c9-8108496b4171 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:29.406759 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b555b60a-bafd-4d3b-88c9-8108496b4171 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:29.407231 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b555b60a-bafd-4d3b-88c9-8108496b4171 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:29.407930 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b555b60a-bafd-4d3b-88c9-8108496b4171 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:29.408379 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b555b60a-bafd-4d3b-88c9-8108496b4171 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:29.408796 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b555b60a-bafd-4d3b-88c9-8108496b4171 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:29.460525 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-bf757964-bf26-4cbd-bd4a-3e2252801a42 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:29.468525 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-bf757964-bf26-4cbd-bd4a-3e2252801a42 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74" status: 200 len: 1680 microversion: 2.1 time: 0.163540 Oct 24 08:52:29.469092 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 284/569] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:29 2022] GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:29.545189 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-b555b60a-bafd-4d3b-88c9-8108496b4171 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:29.553640 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-b555b60a-bafd-4d3b-88c9-8108496b4171 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1735 microversion: 2.1 time: 0.158600 Oct 24 08:52:29.554224 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 286/570] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:29 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:30.492460 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-7daec95d-4621-4bf1-bb37-665dd3e68803 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:30.493155 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-7daec95d-4621-4bf1-bb37-665dd3e68803 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 880d7b45-efa0-4aec-9342-b84795db3c74] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:30.499993 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7daec95d-4621-4bf1-bb37-665dd3e68803 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:30.500456 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7daec95d-4621-4bf1-bb37-665dd3e68803 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:30.500891 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7daec95d-4621-4bf1-bb37-665dd3e68803 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:30.501587 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7daec95d-4621-4bf1-bb37-665dd3e68803 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:30.502042 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7daec95d-4621-4bf1-bb37-665dd3e68803 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:30.502466 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7daec95d-4621-4bf1-bb37-665dd3e68803 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:30.577476 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-f0bf5b73-ed1a-4f9e-ae7d-a19a0c5aa354 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:30.578056 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-f0bf5b73-ed1a-4f9e-ae7d-a19a0c5aa354 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:30.584373 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f0bf5b73-ed1a-4f9e-ae7d-a19a0c5aa354 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:30.584861 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f0bf5b73-ed1a-4f9e-ae7d-a19a0c5aa354 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:30.585417 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f0bf5b73-ed1a-4f9e-ae7d-a19a0c5aa354 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:30.586108 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f0bf5b73-ed1a-4f9e-ae7d-a19a0c5aa354 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:30.586530 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f0bf5b73-ed1a-4f9e-ae7d-a19a0c5aa354 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:30.587017 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f0bf5b73-ed1a-4f9e-ae7d-a19a0c5aa354 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:30.800664 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-7daec95d-4621-4bf1-bb37-665dd3e68803 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:30.808952 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-7daec95d-4621-4bf1-bb37-665dd3e68803 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74" status: 200 len: 1680 microversion: 2.1 time: 0.320367 Oct 24 08:52:30.809670 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 285/571] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:30 2022] GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74 => generated 1680 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:30.850081 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-f0bf5b73-ed1a-4f9e-ae7d-a19a0c5aa354 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:30.858408 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-f0bf5b73-ed1a-4f9e-ae7d-a19a0c5aa354 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1735 microversion: 2.1 time: 0.285055 Oct 24 08:52:30.858993 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 287/572] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:30 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1735 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:31.280361 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-0c39426a-f9d0-4283-9fea-18c3e3254a8d req-81f3b0f6-2517-4af4-8111-107e81f1f9ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "880d7b45-efa0-4aec-9342-b84795db3c74", "name": "network-vif-deleted", "tag": "1b98709b-e1ec-4e41-be52-911e7f2f8294"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:31.291395 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-0c39426a-f9d0-4283-9fea-18c3e3254a8d req-81f3b0f6-2517-4af4-8111-107e81f1f9ba service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:31.291956 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-0c39426a-f9d0-4283-9fea-18c3e3254a8d req-81f3b0f6-2517-4af4-8111-107e81f1f9ba service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:31.292441 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-0c39426a-f9d0-4283-9fea-18c3e3254a8d req-81f3b0f6-2517-4af4-8111-107e81f1f9ba service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:31.305449 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-0c39426a-f9d0-4283-9fea-18c3e3254a8d req-81f3b0f6-2517-4af4-8111-107e81f1f9ba service nova] Creating event network-vif-deleted:1b98709b-e1ec-4e41-be52-911e7f2f8294 for instance 880d7b45-efa0-4aec-9342-b84795db3c74 on hv-cinder-maste Oct 24 08:52:31.310422 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-0c39426a-f9d0-4283-9fea-18c3e3254a8d req-81f3b0f6-2517-4af4-8111-107e81f1f9ba service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033807 Oct 24 08:52:31.314804 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 286/573] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:52:31.832250 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-8c99f557-fc9c-45b8-bb7d-921235715503 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:31.833525 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-8c99f557-fc9c-45b8-bb7d-921235715503 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 880d7b45-efa0-4aec-9342-b84795db3c74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:31.840088 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8c99f557-fc9c-45b8-bb7d-921235715503 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:31.840901 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8c99f557-fc9c-45b8-bb7d-921235715503 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:31.841340 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8c99f557-fc9c-45b8-bb7d-921235715503 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:31.842048 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8c99f557-fc9c-45b8-bb7d-921235715503 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:31.842471 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8c99f557-fc9c-45b8-bb7d-921235715503 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:31.842968 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8c99f557-fc9c-45b8-bb7d-921235715503 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:31.876642 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8c99f557-fc9c-45b8-bb7d-921235715503 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:31.877516 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8c99f557-fc9c-45b8-bb7d-921235715503 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:31.877943 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8c99f557-fc9c-45b8-bb7d-921235715503 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:31.878432 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.objects.instance [None req-8c99f557-fc9c-45b8-bb7d-921235715503 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lazy-loading 'fault' on Instance uuid 880d7b45-efa0-4aec-9342-b84795db3c74 {{(pid=125165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:52:31.882768 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-ccfada09-21b2-4ae1-8ff8-990f19404ac2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:31.884274 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-ccfada09-21b2-4ae1-8ff8-990f19404ac2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:31.891522 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ccfada09-21b2-4ae1-8ff8-990f19404ac2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:31.892489 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ccfada09-21b2-4ae1-8ff8-990f19404ac2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:31.892926 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ccfada09-21b2-4ae1-8ff8-990f19404ac2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:31.893656 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ccfada09-21b2-4ae1-8ff8-990f19404ac2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:31.894264 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ccfada09-21b2-4ae1-8ff8-990f19404ac2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:31.894686 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ccfada09-21b2-4ae1-8ff8-990f19404ac2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:31.925909 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-8c99f557-fc9c-45b8-bb7d-921235715503 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:31.934398 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-8c99f557-fc9c-45b8-bb7d-921235715503 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74" status: 200 len: 1330 microversion: 2.1 time: 0.106124 Oct 24 08:52:31.935074 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 288/574] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:31 2022] GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74 => generated 1330 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:32.031113 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-ccfada09-21b2-4ae1-8ff8-990f19404ac2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:32.039753 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-ccfada09-21b2-4ae1-8ff8-990f19404ac2 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1735 microversion: 2.1 time: 0.161748 Oct 24 08:52:32.054740 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 287/575] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:31 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:32.958214 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-57398658-5152-48d6-9660-eec779452bed tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:32.958866 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-57398658-5152-48d6-9660-eec779452bed tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 880d7b45-efa0-4aec-9342-b84795db3c74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:32.965624 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-57398658-5152-48d6-9660-eec779452bed tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:32.966110 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-57398658-5152-48d6-9660-eec779452bed tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:32.966545 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-57398658-5152-48d6-9660-eec779452bed tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:32.967301 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-57398658-5152-48d6-9660-eec779452bed tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:32.967727 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-57398658-5152-48d6-9660-eec779452bed tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:32.968141 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-57398658-5152-48d6-9660-eec779452bed tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:32.982830 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.wsgi [None req-57398658-5152-48d6-9660-eec779452bed tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] HTTP exception thrown: Instance 880d7b45-efa0-4aec-9342-b84795db3c74 could not be found. Oct 24 08:52:32.984732 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-57398658-5152-48d6-9660-eec779452bed tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Request method failure captured: Oct 24 08:52:32.984732 dv-cinder-master-3-smb devstack@n-api.service[125165]: request: GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74 HTTP/1.1 Oct 24 08:52:32.984732 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept: application/json Oct 24 08:52:32.984732 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept-Encoding: identity Oct 24 08:52:32.984732 dv-cinder-master-3-smb devstack@n-api.service[125165]: Connection: close Oct 24 08:52:32.984732 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Length: 0 Oct 24 08:52:32.984732 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Type: application/json Oct 24 08:52:32.984732 dv-cinder-master-3-smb devstack@n-api.service[125165]: Host: 10.222.0.26 Oct 24 08:52:32.984732 dv-cinder-master-3-smb devstack@n-api.service[125165]: Openstack-System-Scope: None Oct 24 08:52:32.984732 dv-cinder-master-3-smb devstack@n-api.service[125165]: User-Agent: python-urllib3/1.26.12 Oct 24 08:52:32.984732 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Auth-Token: gAAAAABjVlE2u8htP-0ukfebxjPQ_Tv08AEgRkqfcKErVq7KuTRTMT0ulC9K9eGWmc0J9Q6UTd3t0f_FhG9s34JNa-sHLE0_eBaC2GRhGdxZJM_viMU6wO-8X3T5-_M7hKYRa28fguCQkp2kM0S7f5w35MMqRh0sMsrU0PYXCVdXzPLgYLOBkKQ Oct 24 08:52:32.984732 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Id: None Oct 24 08:52:32.984732 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Name: None Oct 24 08:52:32.984732 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Identity-Status: Confirmed Oct 24 08:52:32.984732 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Is-Admin-Project: True Oct 24 08:52:32.984732 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Id: default Oct 24 08:52:32.984732 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Name: Default Oct 24 08:52:32.984732 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Id: 02be1b30677f400788b35b03938e44e5 Oct 24 08:52:32.984732 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Name: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:52:32.984732 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Role: reader,member Oct 24 08:52:32.984732 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Roles: reader,member Oct 24 08:52:32.986242 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_02be1b30677f400788b35b03938e44e5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/02be1b30677f400788b35b03938e44e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02be1b30677f400788b35b03938e44e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02be1b30677f400788b35b03938e44e5"}]}] Oct 24 08:52:32.986242 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:52:32.986242 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Id: 02be1b30677f400788b35b03938e44e5 Oct 24 08:52:32.986242 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:52:32.986242 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User: tempest-AttachVolumeNegativeTest-1868225476-project Oct 24 08:52:32.986242 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Id: default Oct 24 08:52:32.986242 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Name: Default Oct 24 08:52:32.986242 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Id: 712e5cf4cc004918817ab1802b9c69d6 Oct 24 08:52:32.986242 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Name: tempest-AttachVolumeNegativeTest-1868225476-project Oct 24 08:52:32.986242 dv-cinder-master-3-smb devstack@n-api.service[125165]: method: > Oct 24 08:52:32.986242 dv-cinder-master-3-smb devstack@n-api.service[125165]: exception: Instance 880d7b45-efa0-4aec-9342-b84795db3c74 could not be found. Oct 24 08:52:32.986242 dv-cinder-master-3-smb devstack@n-api.service[125165]: action_args: {'id': '880d7b45-efa0-4aec-9342-b84795db3c74'} Oct 24 08:52:32.990563 dv-cinder-master-3-smb devstack@n-api.service[125165]: {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:52:32.990563 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:32.990563 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:52:32.990563 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:52:32.990563 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:52:32.990563 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:52:32.990563 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:52:32.990563 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:52:32.990563 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:52:32.990563 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:52:32.990563 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 880d7b45-efa0-4aec-9342-b84795db3c74 could not be found. Oct 24 08:52:32.990563 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:52:32.990563 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:32.990563 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:52:32.990563 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:32.990563 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:32.990563 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:32.990563 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:52:32.990563 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:52:32.990563 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:52:32.992166 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:52:32.992166 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:52:32.992166 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:52:32.992166 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:52:32.992166 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:52:32.992166 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:52:32.992166 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:52:32.992166 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 880d7b45-efa0-4aec-9342-b84795db3c74 could not be found. Oct 24 08:52:32.992166 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:52:32.992166 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:32.992166 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:52:32.992166 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:32.992166 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:32.992166 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:32.992166 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:52:32.992166 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:52:32.992166 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 880d7b45-efa0-4aec-9342-b84795db3c74 could not be found. Oct 24 08:52:32.992166 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:52:32.993399 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-57398658-5152-48d6-9660-eec779452bed tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Returning 404 to user: Instance 880d7b45-efa0-4aec-9342-b84795db3c74 could not be found. {{(pid=125165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:52:32.993399 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-57398658-5152-48d6-9660-eec779452bed tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74" status: 404 len: 111 microversion: 2.1 time: 0.032034 Oct 24 08:52:32.993399 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 289/576] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:32 2022] GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:52:32.997348 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-144c22ee-1c68-488f-9b75-f20a1c2304a9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '.version_select at 0x7f7ef1703940>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:33.021362 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-144c22ee-1c68-488f-9b75-f20a1c2304a9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-26474901" status: 202 len: 0 microversion: 2.1 time: 0.029058 Oct 24 08:52:33.022047 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 288/577] 10.222.0.26 () {58 vars in 1215 bytes} [Mon Oct 24 08:52:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-26474901 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:52:33.064187 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-b9b5e1c5-70ec-4eee-afb6-e4b6907cf14f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:33.064969 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-b9b5e1c5-70ec-4eee-afb6-e4b6907cf14f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:33.071615 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b9b5e1c5-70ec-4eee-afb6-e4b6907cf14f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:33.072277 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b9b5e1c5-70ec-4eee-afb6-e4b6907cf14f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:33.072825 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b9b5e1c5-70ec-4eee-afb6-e4b6907cf14f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:33.073676 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b9b5e1c5-70ec-4eee-afb6-e4b6907cf14f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:33.074239 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b9b5e1c5-70ec-4eee-afb6-e4b6907cf14f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:33.074772 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b9b5e1c5-70ec-4eee-afb6-e4b6907cf14f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:33.257065 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-b9b5e1c5-70ec-4eee-afb6-e4b6907cf14f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:33.278080 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-b9b5e1c5-70ec-4eee-afb6-e4b6907cf14f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1735 microversion: 2.1 time: 0.217676 Oct 24 08:52:33.278639 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 290/578] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:33 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1735 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:33.789435 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-6434d8ea-0f0a-4e13-a5b2-cb859f441ae2 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:33.789927 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-6434d8ea-0f0a-4e13-a5b2-cb859f441ae2 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:33.797114 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6434d8ea-0f0a-4e13-a5b2-cb859f441ae2 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:33.797598 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6434d8ea-0f0a-4e13-a5b2-cb859f441ae2 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:33.798026 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6434d8ea-0f0a-4e13-a5b2-cb859f441ae2 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:33.798742 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6434d8ea-0f0a-4e13-a5b2-cb859f441ae2 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:33.799186 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6434d8ea-0f0a-4e13-a5b2-cb859f441ae2 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:33.799634 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6434d8ea-0f0a-4e13-a5b2-cb859f441ae2 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:33.929753 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.objects.instance [None req-6434d8ea-0f0a-4e13-a5b2-cb859f441ae2 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lazy-loading 'services' on Instance uuid f6890641-4753-4fb7-86a4-fb5782b1b5b1 {{(pid=125164) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:52:34.055781 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-6434d8ea-0f0a-4e13-a5b2-cb859f441ae2 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1/os-volume_attachments/2eaf1852-e435-4848-8e43-a496b4d5ceaa" status: 202 len: 0 microversion: 2.1 time: 0.270289 Oct 24 08:52:34.056506 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 289/579] 10.222.0.26 () {58 vars in 1416 bytes} [Mon Oct 24 08:52:33 2022] DELETE /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1/os-volume_attachments/2eaf1852-e435-4848-8e43-a496b4d5ceaa => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:52:34.065560 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-5975d345-83b6-41d4-a0f3-dfce994b1ec1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:34.067955 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-5975d345-83b6-41d4-a0f3-dfce994b1ec1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:34.074596 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5975d345-83b6-41d4-a0f3-dfce994b1ec1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:34.075077 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5975d345-83b6-41d4-a0f3-dfce994b1ec1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:34.075509 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5975d345-83b6-41d4-a0f3-dfce994b1ec1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:34.076186 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5975d345-83b6-41d4-a0f3-dfce994b1ec1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:34.077203 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5975d345-83b6-41d4-a0f3-dfce994b1ec1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:34.077757 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5975d345-83b6-41d4-a0f3-dfce994b1ec1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:34.107839 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-5975d345-83b6-41d4-a0f3-dfce994b1ec1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046921 Oct 24 08:52:34.108366 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 291/580] 10.222.0.26 () {58 vars in 1302 bytes} [Mon Oct 24 08:52:34 2022] GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:52:34.303293 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-724f7430-681b-41aa-a9e3-0ad62c683fe1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:34.304096 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-724f7430-681b-41aa-a9e3-0ad62c683fe1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:34.310606 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-724f7430-681b-41aa-a9e3-0ad62c683fe1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:34.311129 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-724f7430-681b-41aa-a9e3-0ad62c683fe1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:34.311567 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-724f7430-681b-41aa-a9e3-0ad62c683fe1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:34.312257 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-724f7430-681b-41aa-a9e3-0ad62c683fe1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:34.312708 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-724f7430-681b-41aa-a9e3-0ad62c683fe1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:34.313130 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-724f7430-681b-41aa-a9e3-0ad62c683fe1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:34.450275 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-724f7430-681b-41aa-a9e3-0ad62c683fe1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:34.458567 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-724f7430-681b-41aa-a9e3-0ad62c683fe1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1735 microversion: 2.1 time: 0.159593 Oct 24 08:52:34.459134 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 290/581] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:34 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:35.121668 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-cd0b1288-4b47-446c-98c9-e4adbb82625d tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:35.123822 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-cd0b1288-4b47-446c-98c9-e4adbb82625d tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:35.129878 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cd0b1288-4b47-446c-98c9-e4adbb82625d tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:35.130367 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cd0b1288-4b47-446c-98c9-e4adbb82625d tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:35.130870 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cd0b1288-4b47-446c-98c9-e4adbb82625d tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:35.131519 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cd0b1288-4b47-446c-98c9-e4adbb82625d tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:35.131963 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cd0b1288-4b47-446c-98c9-e4adbb82625d tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:35.132376 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cd0b1288-4b47-446c-98c9-e4adbb82625d tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:35.161518 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-cd0b1288-4b47-446c-98c9-e4adbb82625d tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044563 Oct 24 08:52:35.162061 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 292/582] 10.222.0.26 () {58 vars in 1302 bytes} [Mon Oct 24 08:52:35 2022] GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:52:35.226418 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-16eb0a65-e614-4166-825c-3a69a3a0d7cc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:35.226993 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-16eb0a65-e614-4166-825c-3a69a3a0d7cc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:35.233792 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-16eb0a65-e614-4166-825c-3a69a3a0d7cc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:35.234273 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-16eb0a65-e614-4166-825c-3a69a3a0d7cc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:35.234700 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-16eb0a65-e614-4166-825c-3a69a3a0d7cc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:35.235417 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-16eb0a65-e614-4166-825c-3a69a3a0d7cc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:35.235860 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-16eb0a65-e614-4166-825c-3a69a3a0d7cc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:35.236275 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-16eb0a65-e614-4166-825c-3a69a3a0d7cc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:35.261098 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-16eb0a65-e614-4166-825c-3a69a3a0d7cc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Going to try to terminate instance {{(pid=125164) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:52:35.313049 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=91,nova_cell1:UPDATE=5 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:35.347242 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-16eb0a65-e614-4166-825c-3a69a3a0d7cc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1" status: 204 len: 0 microversion: 2.1 time: 0.124345 Oct 24 08:52:35.348119 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 291/583] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Oct 24 08:52:35 2022] DELETE /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:52:35.357370 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-3c631dbb-dd6d-4574-acc0-d36712d8e3dd tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:35.357990 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-3c631dbb-dd6d-4574-acc0-d36712d8e3dd tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:35.363965 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3c631dbb-dd6d-4574-acc0-d36712d8e3dd tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:35.364435 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3c631dbb-dd6d-4574-acc0-d36712d8e3dd tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:35.364860 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3c631dbb-dd6d-4574-acc0-d36712d8e3dd tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:35.365672 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3c631dbb-dd6d-4574-acc0-d36712d8e3dd tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:35.366124 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3c631dbb-dd6d-4574-acc0-d36712d8e3dd tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:35.366536 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3c631dbb-dd6d-4574-acc0-d36712d8e3dd tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:35.482440 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-2aa32bce-a174-40e8-8647-334637b564c5 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:35.483180 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-2aa32bce-a174-40e8-8647-334637b564c5 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:35.489489 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2aa32bce-a174-40e8-8647-334637b564c5 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:35.490005 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2aa32bce-a174-40e8-8647-334637b564c5 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:35.490440 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2aa32bce-a174-40e8-8647-334637b564c5 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:35.491183 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2aa32bce-a174-40e8-8647-334637b564c5 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:35.491641 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2aa32bce-a174-40e8-8647-334637b564c5 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:35.492064 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2aa32bce-a174-40e8-8647-334637b564c5 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:35.502709 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-3c631dbb-dd6d-4574-acc0-d36712d8e3dd tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:35.510525 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-3c631dbb-dd6d-4574-acc0-d36712d8e3dd tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1" status: 200 len: 1684 microversion: 2.1 time: 0.157156 Oct 24 08:52:35.511118 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 293/584] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:35 2022] GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:35.626750 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-2aa32bce-a174-40e8-8647-334637b564c5 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:35.635338 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-2aa32bce-a174-40e8-8647-334637b564c5 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1735 microversion: 2.1 time: 0.157291 Oct 24 08:52:35.636268 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 292/585] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:35 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:36.538230 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-069bb474-1595-47f4-96ab-46e84edf306e tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:36.539128 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-069bb474-1595-47f4-96ab-46e84edf306e tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:36.549812 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-069bb474-1595-47f4-96ab-46e84edf306e tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:36.550659 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-069bb474-1595-47f4-96ab-46e84edf306e tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:36.551416 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-069bb474-1595-47f4-96ab-46e84edf306e tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:36.552532 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-069bb474-1595-47f4-96ab-46e84edf306e tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:36.553271 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-069bb474-1595-47f4-96ab-46e84edf306e tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:36.553964 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-069bb474-1595-47f4-96ab-46e84edf306e tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:36.657752 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-d6e2c0e5-f119-4a00-956c-4158adcd8810 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:36.658370 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-d6e2c0e5-f119-4a00-956c-4158adcd8810 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:36.664702 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d6e2c0e5-f119-4a00-956c-4158adcd8810 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:36.665191 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d6e2c0e5-f119-4a00-956c-4158adcd8810 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:36.665677 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d6e2c0e5-f119-4a00-956c-4158adcd8810 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:36.666371 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d6e2c0e5-f119-4a00-956c-4158adcd8810 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:36.666846 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d6e2c0e5-f119-4a00-956c-4158adcd8810 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:36.667587 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d6e2c0e5-f119-4a00-956c-4158adcd8810 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:36.797467 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-069bb474-1595-47f4-96ab-46e84edf306e tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:36.805425 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-069bb474-1595-47f4-96ab-46e84edf306e tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1" status: 200 len: 1684 microversion: 2.1 time: 0.273672 Oct 24 08:52:36.806068 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 294/586] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:36 2022] GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 => generated 1684 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:36.824683 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-d6e2c0e5-f119-4a00-956c-4158adcd8810 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:36.833130 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-d6e2c0e5-f119-4a00-956c-4158adcd8810 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1735 microversion: 2.1 time: 0.179137 Oct 24 08:52:36.833690 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 293/587] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:36 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:52:37.828552 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-84ae94d4-9039-4a42-ab82-8328d7c228f9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:37.829156 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-84ae94d4-9039-4a42-ab82-8328d7c228f9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:37.835810 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-84ae94d4-9039-4a42-ab82-8328d7c228f9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:37.836296 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-84ae94d4-9039-4a42-ab82-8328d7c228f9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:37.836729 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-84ae94d4-9039-4a42-ab82-8328d7c228f9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:37.837466 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-84ae94d4-9039-4a42-ab82-8328d7c228f9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:37.837987 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-84ae94d4-9039-4a42-ab82-8328d7c228f9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:37.838442 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-84ae94d4-9039-4a42-ab82-8328d7c228f9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:37.857248 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-1c7abd10-b812-4951-9738-4da8bf8e98bf tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:37.858569 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-1c7abd10-b812-4951-9738-4da8bf8e98bf tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:37.864906 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1c7abd10-b812-4951-9738-4da8bf8e98bf tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:37.865386 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1c7abd10-b812-4951-9738-4da8bf8e98bf tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:37.865815 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1c7abd10-b812-4951-9738-4da8bf8e98bf tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:37.866531 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1c7abd10-b812-4951-9738-4da8bf8e98bf tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:37.866973 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1c7abd10-b812-4951-9738-4da8bf8e98bf tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:37.867388 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1c7abd10-b812-4951-9738-4da8bf8e98bf tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:38.372367 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-84ae94d4-9039-4a42-ab82-8328d7c228f9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:38.380686 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-84ae94d4-9039-4a42-ab82-8328d7c228f9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1" status: 200 len: 1684 microversion: 2.1 time: 0.556032 Oct 24 08:52:38.381243 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 295/588] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:37 2022] GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 => generated 1684 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:38.445329 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-1c7abd10-b812-4951-9738-4da8bf8e98bf tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:38.454312 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-1c7abd10-b812-4951-9738-4da8bf8e98bf tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1735 microversion: 2.1 time: 0.600953 Oct 24 08:52:38.454928 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 294/589] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:37 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1735 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:38.917627 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-d42246e6-a5f1-47ad-8d0d-5b8e1afe5071 req-d163fd72-58ee-41d3-b947-776923372d6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6890641-4753-4fb7-86a4-fb5782b1b5b1", "name": "network-vif-deleted", "tag": "20f1d856-5c54-4f99-8f43-55b3a29d8726"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:38.928524 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-d42246e6-a5f1-47ad-8d0d-5b8e1afe5071 req-d163fd72-58ee-41d3-b947-776923372d6b service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:38.929006 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-d42246e6-a5f1-47ad-8d0d-5b8e1afe5071 req-d163fd72-58ee-41d3-b947-776923372d6b service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:38.929432 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-d42246e6-a5f1-47ad-8d0d-5b8e1afe5071 req-d163fd72-58ee-41d3-b947-776923372d6b service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:38.940737 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-d42246e6-a5f1-47ad-8d0d-5b8e1afe5071 req-d163fd72-58ee-41d3-b947-776923372d6b service nova] Creating event network-vif-deleted:20f1d856-5c54-4f99-8f43-55b3a29d8726 for instance f6890641-4753-4fb7-86a4-fb5782b1b5b1 on hv-cinder-maste Oct 24 08:52:38.945798 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-d42246e6-a5f1-47ad-8d0d-5b8e1afe5071 req-d163fd72-58ee-41d3-b947-776923372d6b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031801 Oct 24 08:52:38.946410 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 296/590] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:52:39.405477 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-5e3ca5dc-5bf6-4ae1-b303-87f06a88ae63 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:39.406300 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-5e3ca5dc-5bf6-4ae1-b303-87f06a88ae63 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:39.413364 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5e3ca5dc-5bf6-4ae1-b303-87f06a88ae63 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:39.414024 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5e3ca5dc-5bf6-4ae1-b303-87f06a88ae63 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:39.414754 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5e3ca5dc-5bf6-4ae1-b303-87f06a88ae63 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:39.415720 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5e3ca5dc-5bf6-4ae1-b303-87f06a88ae63 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:39.416250 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5e3ca5dc-5bf6-4ae1-b303-87f06a88ae63 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:39.416862 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5e3ca5dc-5bf6-4ae1-b303-87f06a88ae63 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:39.478368 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-d16e3513-e396-4bbb-9e0f-0f871fd38189 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:39.479493 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-d16e3513-e396-4bbb-9e0f-0f871fd38189 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:39.482825 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-5e3ca5dc-5bf6-4ae1-b303-87f06a88ae63 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:39.491643 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d16e3513-e396-4bbb-9e0f-0f871fd38189 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:39.492174 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d16e3513-e396-4bbb-9e0f-0f871fd38189 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:39.492609 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d16e3513-e396-4bbb-9e0f-0f871fd38189 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:39.493510 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d16e3513-e396-4bbb-9e0f-0f871fd38189 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:39.494055 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d16e3513-e396-4bbb-9e0f-0f871fd38189 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:39.494476 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d16e3513-e396-4bbb-9e0f-0f871fd38189 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:39.494885 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-5e3ca5dc-5bf6-4ae1-b303-87f06a88ae63 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1" status: 200 len: 1616 microversion: 2.1 time: 0.094220 Oct 24 08:52:39.499100 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 295/591] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:39 2022] GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 => generated 1616 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:39.667607 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-d16e3513-e396-4bbb-9e0f-0f871fd38189 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:39.676422 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-d16e3513-e396-4bbb-9e0f-0f871fd38189 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1735 microversion: 2.1 time: 0.202976 Oct 24 08:52:39.676989 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 297/592] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:39 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1735 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:52:40.522659 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-24f90260-337e-425c-a89c-26cc9ca3508b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:40.523559 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-24f90260-337e-425c-a89c-26cc9ca3508b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:40.531300 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-24f90260-337e-425c-a89c-26cc9ca3508b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:40.531783 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-24f90260-337e-425c-a89c-26cc9ca3508b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:40.532209 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-24f90260-337e-425c-a89c-26cc9ca3508b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:40.532895 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-24f90260-337e-425c-a89c-26cc9ca3508b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:40.533368 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-24f90260-337e-425c-a89c-26cc9ca3508b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:40.533783 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-24f90260-337e-425c-a89c-26cc9ca3508b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:40.565259 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-24f90260-337e-425c-a89c-26cc9ca3508b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:40.565730 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-24f90260-337e-425c-a89c-26cc9ca3508b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:40.566153 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-24f90260-337e-425c-a89c-26cc9ca3508b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:40.566587 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.objects.instance [None req-24f90260-337e-425c-a89c-26cc9ca3508b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lazy-loading 'fault' on Instance uuid f6890641-4753-4fb7-86a4-fb5782b1b5b1 {{(pid=125164) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:52:40.607571 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-24f90260-337e-425c-a89c-26cc9ca3508b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:40.615198 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-24f90260-337e-425c-a89c-26cc9ca3508b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1" status: 200 len: 1332 microversion: 2.1 time: 0.099139 Oct 24 08:52:40.615767 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 296/593] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:40 2022] GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 => generated 1332 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:40.701926 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-134cd8b5-9c53-40e7-b609-198c69d1690f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:40.704617 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-134cd8b5-9c53-40e7-b609-198c69d1690f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:40.711210 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-134cd8b5-9c53-40e7-b609-198c69d1690f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:40.711687 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-134cd8b5-9c53-40e7-b609-198c69d1690f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:40.712119 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-134cd8b5-9c53-40e7-b609-198c69d1690f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:40.712795 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-134cd8b5-9c53-40e7-b609-198c69d1690f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:40.713243 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-134cd8b5-9c53-40e7-b609-198c69d1690f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:40.713659 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-134cd8b5-9c53-40e7-b609-198c69d1690f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:40.897818 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-134cd8b5-9c53-40e7-b609-198c69d1690f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:40.909862 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-134cd8b5-9c53-40e7-b609-198c69d1690f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1735 microversion: 2.1 time: 0.211602 Oct 24 08:52:40.910624 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 298/594] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:40 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1735 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:41.642673 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-abcd20f6-580b-47ed-92bc-7b8de7921708 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:41.643663 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-abcd20f6-580b-47ed-92bc-7b8de7921708 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:41.655532 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-abcd20f6-580b-47ed-92bc-7b8de7921708 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:41.656330 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-abcd20f6-580b-47ed-92bc-7b8de7921708 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:41.657048 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-abcd20f6-580b-47ed-92bc-7b8de7921708 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:41.658199 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-abcd20f6-580b-47ed-92bc-7b8de7921708 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:41.659041 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-abcd20f6-580b-47ed-92bc-7b8de7921708 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:41.659736 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-abcd20f6-580b-47ed-92bc-7b8de7921708 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:41.693903 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-abcd20f6-580b-47ed-92bc-7b8de7921708 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:41.694384 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-abcd20f6-580b-47ed-92bc-7b8de7921708 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:41.694854 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-abcd20f6-580b-47ed-92bc-7b8de7921708 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:41.695309 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.objects.instance [None req-abcd20f6-580b-47ed-92bc-7b8de7921708 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lazy-loading 'fault' on Instance uuid f6890641-4753-4fb7-86a4-fb5782b1b5b1 {{(pid=125164) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:52:41.739983 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-abcd20f6-580b-47ed-92bc-7b8de7921708 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:41.747844 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-abcd20f6-580b-47ed-92bc-7b8de7921708 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1" status: 200 len: 1332 microversion: 2.1 time: 0.111623 Oct 24 08:52:41.748407 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 297/595] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:41 2022] GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 => generated 1332 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:41.935325 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-603bea47-fb38-4c6a-aead-35fecab8e7a9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:41.936657 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-603bea47-fb38-4c6a-aead-35fecab8e7a9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:41.943537 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-603bea47-fb38-4c6a-aead-35fecab8e7a9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:41.944100 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-603bea47-fb38-4c6a-aead-35fecab8e7a9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:41.944627 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-603bea47-fb38-4c6a-aead-35fecab8e7a9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:41.945466 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-603bea47-fb38-4c6a-aead-35fecab8e7a9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:41.946082 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-603bea47-fb38-4c6a-aead-35fecab8e7a9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:41.946802 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-603bea47-fb38-4c6a-aead-35fecab8e7a9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:42.145952 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-603bea47-fb38-4c6a-aead-35fecab8e7a9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:42.159646 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-603bea47-fb38-4c6a-aead-35fecab8e7a9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1715 microversion: 2.1 time: 0.228080 Oct 24 08:52:42.160745 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 299/596] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:41 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1715 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:42.276426 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-48e17e80-6439-41da-86c6-f6fbca2419f7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:42.276951 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-48e17e80-6439-41da-86c6-f6fbca2419f7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:42.283079 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-48e17e80-6439-41da-86c6-f6fbca2419f7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:42.283753 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-48e17e80-6439-41da-86c6-f6fbca2419f7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:42.284196 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-48e17e80-6439-41da-86c6-f6fbca2419f7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:42.285403 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-48e17e80-6439-41da-86c6-f6fbca2419f7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:42.285403 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-48e17e80-6439-41da-86c6-f6fbca2419f7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:42.285747 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-48e17e80-6439-41da-86c6-f6fbca2419f7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:42.374221 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.wsgi [None req-48e17e80-6439-41da-86c6-f6fbca2419f7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] HTTP exception thrown: Cannot 'detach_volume' instance f891147d-0b78-40f9-a17c-e1c9dbbc9f74 while it is in vm_state rescued Oct 24 08:52:42.375907 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-48e17e80-6439-41da-86c6-f6fbca2419f7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Request method failure captured: Oct 24 08:52:42.375907 dv-cinder-master-3-smb devstack@n-api.service[125164]: request: DELETE /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74/os-volume_attachments/3ff9a9f1-f85f-4d3f-912b-6497606a6b26 HTTP/1.1 Oct 24 08:52:42.375907 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept: application/json Oct 24 08:52:42.375907 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept-Encoding: identity Oct 24 08:52:42.375907 dv-cinder-master-3-smb devstack@n-api.service[125164]: Connection: close Oct 24 08:52:42.375907 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Length: 0 Oct 24 08:52:42.375907 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Type: application/json Oct 24 08:52:42.375907 dv-cinder-master-3-smb devstack@n-api.service[125164]: Host: 10.222.0.26 Oct 24 08:52:42.375907 dv-cinder-master-3-smb devstack@n-api.service[125164]: Openstack-System-Scope: None Oct 24 08:52:42.375907 dv-cinder-master-3-smb devstack@n-api.service[125164]: User-Agent: python-urllib3/1.26.12 Oct 24 08:52:42.375907 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Auth-Token: gAAAAABjVlE8fgt8TlV2Xk75DOKAirPHmxhZbk5PsnSOl8uKrHSmt8vLmZl9wsWtMWHbcvrINjM9NbHEp6Z2bqeDRmCulVrREKjtNSMRyV38Pb1ReI6MoKQRPQUQO_4JYRXXssXJ145YNsyFbdDiFmugxAp3rv3PlVN7Qyts1ETOZ8colLD_vTs Oct 24 08:52:42.375907 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Id: None Oct 24 08:52:42.375907 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Name: None Oct 24 08:52:42.375907 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Identity-Status: Confirmed Oct 24 08:52:42.375907 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Is-Admin-Project: True Oct 24 08:52:42.375907 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Id: default Oct 24 08:52:42.375907 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Name: Default Oct 24 08:52:42.375907 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Id: f063c719bcda47e6874437d32d284815 Oct 24 08:52:42.375907 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-577585278 Oct 24 08:52:42.375907 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Role: reader,member Oct 24 08:52:42.375907 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Roles: reader,member Oct 24 08:52:42.377409 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f063c719bcda47e6874437d32d284815", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f063c719bcda47e6874437d32d284815"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f063c719bcda47e6874437d32d284815"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f063c719bcda47e6874437d32d284815"}]}] Oct 24 08:52:42.377409 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant: tempest-ServerRescueNegativeTestJSON-577585278 Oct 24 08:52:42.377409 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Id: f063c719bcda47e6874437d32d284815 Oct 24 08:52:42.377409 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-577585278 Oct 24 08:52:42.377409 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User: tempest-ServerRescueNegativeTestJSON-577585278-project Oct 24 08:52:42.377409 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Id: default Oct 24 08:52:42.377409 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Name: Default Oct 24 08:52:42.377409 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Id: 8695364e58b04d829b12ae1b49757536 Oct 24 08:52:42.377409 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Name: tempest-ServerRescueNegativeTestJSON-577585278-project Oct 24 08:52:42.377409 dv-cinder-master-3-smb devstack@n-api.service[125164]: method: > Oct 24 08:52:42.377409 dv-cinder-master-3-smb devstack@n-api.service[125164]: exception: Cannot 'detach_volume' instance f891147d-0b78-40f9-a17c-e1c9dbbc9f74 while it is in vm_state rescued Oct 24 08:52:42.378230 dv-cinder-master-3-smb devstack@n-api.service[125164]: action_args: {'server_id': 'f891147d-0b78-40f9-a17c-e1c9dbbc9f74', 'id': '3ff9a9f1-f85f-4d3f-912b-6497606a6b26'} Oct 24 08:52:42.378230 dv-cinder-master-3-smb devstack@n-api.service[125164]: {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:52:42.378230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:42.378230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 24 08:52:42.378230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 24 08:52:42.378230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 08:52:42.378230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 08:52:42.378230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 24 08:52:42.378230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 24 08:52:42.378230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f891147d-0b78-40f9-a17c-e1c9dbbc9f74 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 24 08:52:42.378230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:52:42.378230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:42.378230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:52:42.378230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:42.378230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:42.378230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:42.378230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:52:42.378230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:52:42.378230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:52:42.378230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:52:42.379780 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 24 08:52:42.379780 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 24 08:52:42.379780 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 24 08:52:42.379780 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 08:52:42.379780 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f891147d-0b78-40f9-a17c-e1c9dbbc9f74 while it is in vm_state rescued Oct 24 08:52:42.379780 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:52:42.379780 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:42.379780 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:52:42.379780 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:42.379780 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:42.379780 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:42.379780 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:52:42.379780 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:52:42.379780 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f891147d-0b78-40f9-a17c-e1c9dbbc9f74 while it is in vm_state rescued Oct 24 08:52:42.379780 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:52:42.379780 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-48e17e80-6439-41da-86c6-f6fbca2419f7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Returning 409 to user: Cannot 'detach_volume' instance f891147d-0b78-40f9-a17c-e1c9dbbc9f74 while it is in vm_state rescued {{(pid=125164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:52:42.380926 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-48e17e80-6439-41da-86c6-f6fbca2419f7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74/os-volume_attachments/3ff9a9f1-f85f-4d3f-912b-6497606a6b26" status: 409 len: 152 microversion: 2.1 time: 0.104983 Oct 24 08:52:42.380926 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 298/597] 10.222.0.26 () {58 vars in 1416 bytes} [Mon Oct 24 08:52:42 2022] DELETE /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74/os-volume_attachments/3ff9a9f1-f85f-4d3f-912b-6497606a6b26 => generated 152 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 08:52:42.387638 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-7c7a72d6-d1c7-4bb2-b3cc-e52eeb17dec8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:42.388189 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-7c7a72d6-d1c7-4bb2-b3cc-e52eeb17dec8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:42.394412 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7c7a72d6-d1c7-4bb2-b3cc-e52eeb17dec8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:42.394929 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7c7a72d6-d1c7-4bb2-b3cc-e52eeb17dec8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:42.395357 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7c7a72d6-d1c7-4bb2-b3cc-e52eeb17dec8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:42.396039 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7c7a72d6-d1c7-4bb2-b3cc-e52eeb17dec8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:42.396489 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7c7a72d6-d1c7-4bb2-b3cc-e52eeb17dec8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:42.396902 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7c7a72d6-d1c7-4bb2-b3cc-e52eeb17dec8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:42.467457 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-7c7a72d6-d1c7-4bb2-b3cc-e52eeb17dec8 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "POST /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74/action" status: 202 len: 0 microversion: 2.1 time: 0.084319 Oct 24 08:52:42.468735 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 300/598] 10.222.0.26 () {60 vars in 1278 bytes} [Mon Oct 24 08:52:42 2022] POST /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:52:42.476175 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-4e560515-a17d-4389-94b2-1942e584f0b9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:42.476791 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-4e560515-a17d-4389-94b2-1942e584f0b9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:42.482815 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4e560515-a17d-4389-94b2-1942e584f0b9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:42.483299 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4e560515-a17d-4389-94b2-1942e584f0b9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:42.483732 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4e560515-a17d-4389-94b2-1942e584f0b9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:42.484412 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4e560515-a17d-4389-94b2-1942e584f0b9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:42.484855 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4e560515-a17d-4389-94b2-1942e584f0b9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:42.485289 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4e560515-a17d-4389-94b2-1942e584f0b9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:42.631027 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-4e560515-a17d-4389-94b2-1942e584f0b9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:42.639907 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-4e560515-a17d-4389-94b2-1942e584f0b9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1723 microversion: 2.1 time: 0.167604 Oct 24 08:52:42.640818 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 299/599] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:42 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:42.770534 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-68b021e6-a3aa-4048-8575-21c0f559abb3 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:42.771569 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-68b021e6-a3aa-4048-8575-21c0f559abb3 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:42.778608 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-68b021e6-a3aa-4048-8575-21c0f559abb3 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:42.779308 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-68b021e6-a3aa-4048-8575-21c0f559abb3 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:42.779866 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-68b021e6-a3aa-4048-8575-21c0f559abb3 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:42.780545 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-68b021e6-a3aa-4048-8575-21c0f559abb3 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:42.780985 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-68b021e6-a3aa-4048-8575-21c0f559abb3 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:42.781396 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-68b021e6-a3aa-4048-8575-21c0f559abb3 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:42.796088 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.wsgi [None req-68b021e6-a3aa-4048-8575-21c0f559abb3 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] HTTP exception thrown: Instance f6890641-4753-4fb7-86a4-fb5782b1b5b1 could not be found. Oct 24 08:52:42.797814 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-68b021e6-a3aa-4048-8575-21c0f559abb3 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Request method failure captured: Oct 24 08:52:42.797814 dv-cinder-master-3-smb devstack@n-api.service[125165]: request: GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 HTTP/1.1 Oct 24 08:52:42.797814 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept: application/json Oct 24 08:52:42.797814 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept-Encoding: identity Oct 24 08:52:42.797814 dv-cinder-master-3-smb devstack@n-api.service[125165]: Connection: close Oct 24 08:52:42.797814 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Length: 0 Oct 24 08:52:42.797814 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Type: application/json Oct 24 08:52:42.797814 dv-cinder-master-3-smb devstack@n-api.service[125165]: Host: 10.222.0.26 Oct 24 08:52:42.797814 dv-cinder-master-3-smb devstack@n-api.service[125165]: Openstack-System-Scope: None Oct 24 08:52:42.797814 dv-cinder-master-3-smb devstack@n-api.service[125165]: User-Agent: python-urllib3/1.26.12 Oct 24 08:52:42.797814 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Auth-Token: gAAAAABjVlE2u8htP-0ukfebxjPQ_Tv08AEgRkqfcKErVq7KuTRTMT0ulC9K9eGWmc0J9Q6UTd3t0f_FhG9s34JNa-sHLE0_eBaC2GRhGdxZJM_viMU6wO-8X3T5-_M7hKYRa28fguCQkp2kM0S7f5w35MMqRh0sMsrU0PYXCVdXzPLgYLOBkKQ Oct 24 08:52:42.797814 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Id: None Oct 24 08:52:42.797814 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Name: None Oct 24 08:52:42.797814 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Identity-Status: Confirmed Oct 24 08:52:42.797814 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Is-Admin-Project: True Oct 24 08:52:42.797814 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Id: default Oct 24 08:52:42.797814 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Name: Default Oct 24 08:52:42.797814 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Id: 02be1b30677f400788b35b03938e44e5 Oct 24 08:52:42.797814 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Name: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:52:42.797814 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Role: reader,member Oct 24 08:52:42.797814 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Roles: reader,member Oct 24 08:52:42.799479 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_02be1b30677f400788b35b03938e44e5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/02be1b30677f400788b35b03938e44e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02be1b30677f400788b35b03938e44e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02be1b30677f400788b35b03938e44e5"}]}] Oct 24 08:52:42.799479 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:52:42.799479 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Id: 02be1b30677f400788b35b03938e44e5 Oct 24 08:52:42.799479 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:52:42.799479 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User: tempest-AttachVolumeNegativeTest-1868225476-project Oct 24 08:52:42.799479 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Id: default Oct 24 08:52:42.799479 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Name: Default Oct 24 08:52:42.799479 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Id: 712e5cf4cc004918817ab1802b9c69d6 Oct 24 08:52:42.799479 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Name: tempest-AttachVolumeNegativeTest-1868225476-project Oct 24 08:52:42.799479 dv-cinder-master-3-smb devstack@n-api.service[125165]: method: > Oct 24 08:52:42.799479 dv-cinder-master-3-smb devstack@n-api.service[125165]: exception: Instance f6890641-4753-4fb7-86a4-fb5782b1b5b1 could not be found. Oct 24 08:52:42.799479 dv-cinder-master-3-smb devstack@n-api.service[125165]: action_args: {'id': 'f6890641-4753-4fb7-86a4-fb5782b1b5b1'} Oct 24 08:52:42.800993 dv-cinder-master-3-smb devstack@n-api.service[125165]: {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:52:42.800993 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:42.800993 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:52:42.800993 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:52:42.800993 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:52:42.800993 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:52:42.800993 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:52:42.800993 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:52:42.800993 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:52:42.800993 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:52:42.800993 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6890641-4753-4fb7-86a4-fb5782b1b5b1 could not be found. Oct 24 08:52:42.800993 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:52:42.800993 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:42.800993 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:52:42.800993 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:42.800993 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:42.800993 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:42.800993 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:52:42.800993 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:52:42.800993 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:52:42.802199 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:52:42.802199 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:52:42.802199 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:52:42.802199 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:52:42.802199 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:52:42.802199 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:52:42.802199 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:52:42.802199 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6890641-4753-4fb7-86a4-fb5782b1b5b1 could not be found. Oct 24 08:52:42.802199 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:52:42.802199 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:52:42.802199 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:52:42.802199 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:52:42.802199 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:52:42.802199 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:52:42.802199 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:52:42.802199 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:52:42.802199 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6890641-4753-4fb7-86a4-fb5782b1b5b1 could not be found. Oct 24 08:52:42.802199 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:52:42.804956 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-68b021e6-a3aa-4048-8575-21c0f559abb3 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Returning 404 to user: Instance f6890641-4753-4fb7-86a4-fb5782b1b5b1 could not be found. {{(pid=125165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:52:42.804956 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-68b021e6-a3aa-4048-8575-21c0f559abb3 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1" status: 404 len: 111 microversion: 2.1 time: 0.033389 Oct 24 08:52:42.804956 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 301/600] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:42 2022] GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:52:42.808406 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-fd7e6e68-abfb-4b9a-bd4f-1c1bab69eebf tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '.version_select at 0x7f7ef24de310>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:42.834579 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-fd7e6e68-abfb-4b9a-bd4f-1c1bab69eebf tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1645717337" status: 202 len: 0 microversion: 2.1 time: 0.030094 Oct 24 08:52:42.835728 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 300/601] 10.222.0.26 () {58 vars in 1221 bytes} [Mon Oct 24 08:52:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1645717337 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:52:43.640412 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-ef700033-5181-4b24-b5a8-866ff8a2caed tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Action: 'create', calling method: .version_select at 0x7f7ef160a8b0>, body: {"keypair": {"name": "tempest-keypair-2100768807", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwmOgaRtejXf9Uvyj+LxfK2ZDmEdOpALlkXdYQxcbc7ocl1mYtYjx+iRKsxDzQXqcKUG2sfO0bHTtd6uytWa2CkknS0LSkGaFGi+HHwKIKPtbqnUwCqTMnrUmggP5/QSQ=="}} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:43.655696 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.quota [None req-ef700033-5181-4b24-b5a8-866ff8a2caed tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Getting quotas for project 02be1b30677f400788b35b03938e44e5. Resources: {'key_pairs'} {{(pid=125165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:52:43.659501 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.quota [None req-ef700033-5181-4b24-b5a8-866ff8a2caed tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Getting quotas for user 712e5cf4cc004918817ab1802b9c69d6 and project 02be1b30677f400788b35b03938e44e5. Resources: {'key_pairs'} {{(pid=125165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:52:43.662648 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-17eaca7b-8783-451c-b3c7-12bbc4e88de3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:43.663281 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-17eaca7b-8783-451c-b3c7-12bbc4e88de3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:43.669950 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-17eaca7b-8783-451c-b3c7-12bbc4e88de3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:43.670450 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-17eaca7b-8783-451c-b3c7-12bbc4e88de3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:43.671006 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-17eaca7b-8783-451c-b3c7-12bbc4e88de3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:43.671656 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-17eaca7b-8783-451c-b3c7-12bbc4e88de3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:43.672329 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-17eaca7b-8783-451c-b3c7-12bbc4e88de3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:43.672939 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-17eaca7b-8783-451c-b3c7-12bbc4e88de3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:43.682996 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-ef700033-5181-4b24-b5a8-866ff8a2caed tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046453 Oct 24 08:52:43.683562 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 302/602] 10.222.0.26 () {60 vars in 1159 bytes} [Mon Oct 24 08:52:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:52:43.850899 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-17eaca7b-8783-451c-b3c7-12bbc4e88de3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:43.859488 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-17eaca7b-8783-451c-b3c7-12bbc4e88de3 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1723 microversion: 2.1 time: 0.200694 Oct 24 08:52:43.860076 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 301/603] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:43 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:44.883891 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-acb06415-91b4-4616-abe1-47696ebb2c65 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:44.885419 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-acb06415-91b4-4616-abe1-47696ebb2c65 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:44.892050 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-acb06415-91b4-4616-abe1-47696ebb2c65 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:44.892608 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-acb06415-91b4-4616-abe1-47696ebb2c65 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:44.893038 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-acb06415-91b4-4616-abe1-47696ebb2c65 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:44.893725 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-acb06415-91b4-4616-abe1-47696ebb2c65 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:44.894167 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-acb06415-91b4-4616-abe1-47696ebb2c65 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:44.894545 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-acb06415-91b4-4616-abe1-47696ebb2c65 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:44.897536 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:45.035763 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-acb06415-91b4-4616-abe1-47696ebb2c65 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:45.044573 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-acb06415-91b4-4616-abe1-47696ebb2c65 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1723 microversion: 2.1 time: 0.164627 Oct 24 08:52:45.045100 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 303/604] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:44 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:45.081400 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-8cbe6250-63af-42a7-a62d-5d4193352526 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-463785380", "imageRef": "7eef2d62-12dc-4746-9cbd-870797d39b4d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "af0d0daa-6faa-4e0a-a58b-da03c7bc2818"}], "security_groups": [{"name": "tempest-securitygroup--1848590064"}], "key_name": "tempest-keypair-2100768807", "user_data": "}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:45.195761 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.network.neutron [None req-8cbe6250-63af-42a7-a62d-5d4193352526 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] validate_networks() for [('af0d0daa-6faa-4e0a-a58b-da03c7bc2818', None, None, None, None, None)] {{(pid=125164) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:52:45.577379 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-8cbe6250-63af-42a7-a62d-5d4193352526 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Flavor limits 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:52:45.577830 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-8cbe6250-63af-42a7-a62d-5d4193352526 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Image limits 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:52:45.578303 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-8cbe6250-63af-42a7-a62d-5d4193352526 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Flavor pref 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:52:45.578711 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-8cbe6250-63af-42a7-a62d-5d4193352526 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Image pref 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:52:45.579155 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-8cbe6250-63af-42a7-a62d-5d4193352526 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:52:45.588382 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8cbe6250-63af-42a7-a62d-5d4193352526 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:45.588861 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8cbe6250-63af-42a7-a62d-5d4193352526 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:45.589293 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8cbe6250-63af-42a7-a62d-5d4193352526 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:45.590019 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8cbe6250-63af-42a7-a62d-5d4193352526 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:45.590467 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8cbe6250-63af-42a7-a62d-5d4193352526 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:45.590911 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8cbe6250-63af-42a7-a62d-5d4193352526 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:45.607860 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.quota [None req-8cbe6250-63af-42a7-a62d-5d4193352526 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Getting quotas for project 02be1b30677f400788b35b03938e44e5. Resources: {'ram', 'cores', 'instances'} {{(pid=125164) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:52:45.612056 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.quota [None req-8cbe6250-63af-42a7-a62d-5d4193352526 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Getting quotas for user 712e5cf4cc004918817ab1802b9c69d6 and project 02be1b30677f400788b35b03938e44e5. Resources: {'ram', 'cores', 'instances'} {{(pid=125164) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:52:45.623616 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-8cbe6250-63af-42a7-a62d-5d4193352526 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Going to run 1 instances... {{(pid=125164) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:52:45.625948 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-8cbe6250-63af-42a7-a62d-5d4193352526 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 9ba684f7-ce77-465c-a6d7-7840517ef487] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7eef2d62-12dc-4746-9cbd-870797d39b4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125164) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:52:45.675305 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-8cbe6250-63af-42a7-a62d-5d4193352526 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.598173 Oct 24 08:52:45.675885 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 302/605] 10.222.0.26 () {60 vars in 1147 bytes} [Mon Oct 24 08:52:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:52:45.687384 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-f020d023-f64a-4169-9204-6a2b1185baf0 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:45.687997 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-f020d023-f64a-4169-9204-6a2b1185baf0 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 9ba684f7-ce77-465c-a6d7-7840517ef487] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:45.753611 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-f020d023-f64a-4169-9204-6a2b1185baf0 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:45.760500 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-f020d023-f64a-4169-9204-6a2b1185baf0 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487" status: 200 len: 1241 microversion: 2.1 time: 0.076987 Oct 24 08:52:45.761067 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 304/606] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:45 2022] GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487 => generated 1241 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:46.069166 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-bab4b59e-ed36-4931-a354-3b10034b2f7a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:46.069788 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-bab4b59e-ed36-4931-a354-3b10034b2f7a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:46.076884 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bab4b59e-ed36-4931-a354-3b10034b2f7a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:46.078306 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bab4b59e-ed36-4931-a354-3b10034b2f7a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:46.078795 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bab4b59e-ed36-4931-a354-3b10034b2f7a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:46.079504 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bab4b59e-ed36-4931-a354-3b10034b2f7a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:46.080012 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bab4b59e-ed36-4931-a354-3b10034b2f7a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:46.080440 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bab4b59e-ed36-4931-a354-3b10034b2f7a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:46.212314 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-bab4b59e-ed36-4931-a354-3b10034b2f7a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:46.220848 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-bab4b59e-ed36-4931-a354-3b10034b2f7a tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1723 microversion: 2.1 time: 0.155970 Oct 24 08:52:46.221418 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 303/607] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:46 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:46.787119 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-6609a550-64b1-4c0f-a198-5dc931792fb5 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:46.788175 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-6609a550-64b1-4c0f-a198-5dc931792fb5 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 9ba684f7-ce77-465c-a6d7-7840517ef487] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:46.795899 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6609a550-64b1-4c0f-a198-5dc931792fb5 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:46.796573 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6609a550-64b1-4c0f-a198-5dc931792fb5 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:46.797011 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6609a550-64b1-4c0f-a198-5dc931792fb5 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:46.797752 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6609a550-64b1-4c0f-a198-5dc931792fb5 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:46.798186 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6609a550-64b1-4c0f-a198-5dc931792fb5 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:46.798615 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6609a550-64b1-4c0f-a198-5dc931792fb5 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:46.862779 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-6609a550-64b1-4c0f-a198-5dc931792fb5 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:46.871132 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-6609a550-64b1-4c0f-a198-5dc931792fb5 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487" status: 200 len: 1293 microversion: 2.1 time: 0.090689 Oct 24 08:52:46.871703 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 305/608] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:46 2022] GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487 => generated 1293 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:47.244736 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-0ed9721d-e395-447b-bffa-d7a36dbd6344 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:47.245324 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-0ed9721d-e395-447b-bffa-d7a36dbd6344 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:47.252254 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0ed9721d-e395-447b-bffa-d7a36dbd6344 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:47.252734 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0ed9721d-e395-447b-bffa-d7a36dbd6344 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:47.253171 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0ed9721d-e395-447b-bffa-d7a36dbd6344 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:47.253850 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0ed9721d-e395-447b-bffa-d7a36dbd6344 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:47.254299 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0ed9721d-e395-447b-bffa-d7a36dbd6344 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:47.254733 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0ed9721d-e395-447b-bffa-d7a36dbd6344 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:47.382149 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-0ed9721d-e395-447b-bffa-d7a36dbd6344 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:47.391234 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-0ed9721d-e395-447b-bffa-d7a36dbd6344 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1729 microversion: 2.1 time: 0.150512 Oct 24 08:52:47.391820 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 304/609] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:47 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:47.413951 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-c21b9d32-4002-406f-9ae8-43ddab671f35 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:47.414437 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-c21b9d32-4002-406f-9ae8-43ddab671f35 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:47.421011 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c21b9d32-4002-406f-9ae8-43ddab671f35 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:47.421497 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c21b9d32-4002-406f-9ae8-43ddab671f35 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:47.421930 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c21b9d32-4002-406f-9ae8-43ddab671f35 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:47.422621 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c21b9d32-4002-406f-9ae8-43ddab671f35 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:47.423101 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c21b9d32-4002-406f-9ae8-43ddab671f35 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:47.423521 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c21b9d32-4002-406f-9ae8-43ddab671f35 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:47.500198 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-c21b9d32-4002-406f-9ae8-43ddab671f35 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090206 Oct 24 08:52:47.500796 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 306/610] 10.222.0.26 () {58 vars in 1275 bytes} [Mon Oct 24 08:52:47 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:52:47.894656 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-52e65b9f-8d82-49a6-bb5a-d744919c6971 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:47.895441 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-52e65b9f-8d82-49a6-bb5a-d744919c6971 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 9ba684f7-ce77-465c-a6d7-7840517ef487] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:47.901606 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-52e65b9f-8d82-49a6-bb5a-d744919c6971 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:47.902089 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-52e65b9f-8d82-49a6-bb5a-d744919c6971 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:47.902515 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-52e65b9f-8d82-49a6-bb5a-d744919c6971 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:47.903236 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-52e65b9f-8d82-49a6-bb5a-d744919c6971 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:47.903731 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-52e65b9f-8d82-49a6-bb5a-d744919c6971 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:47.904098 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-52e65b9f-8d82-49a6-bb5a-d744919c6971 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:48.017204 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-52e65b9f-8d82-49a6-bb5a-d744919c6971 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:48.025246 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-52e65b9f-8d82-49a6-bb5a-d744919c6971 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487" status: 200 len: 1299 microversion: 2.1 time: 0.135023 Oct 24 08:52:48.026068 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 305/611] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:47 2022] GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487 => generated 1299 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:49.048968 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-0b92d748-b2be-444e-995a-a09b7f74c7e8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:49.049583 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-0b92d748-b2be-444e-995a-a09b7f74c7e8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 9ba684f7-ce77-465c-a6d7-7840517ef487] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:49.051580 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:49.057337 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0b92d748-b2be-444e-995a-a09b7f74c7e8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:49.057807 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0b92d748-b2be-444e-995a-a09b7f74c7e8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:49.058239 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0b92d748-b2be-444e-995a-a09b7f74c7e8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:49.058937 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0b92d748-b2be-444e-995a-a09b7f74c7e8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:49.059382 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0b92d748-b2be-444e-995a-a09b7f74c7e8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:49.059792 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0b92d748-b2be-444e-995a-a09b7f74c7e8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:49.128129 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-478b6c39-5e5f-403b-b1c7-0d1f05cd9a42 req-7e79dd6e-ed3b-4926-9cc0-b95e02fe0744 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f891147d-0b78-40f9-a17c-e1c9dbbc9f74", "tag": "d190bfd0-e1fc-4a5c-9d6c-f84bdb6d2209"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:49.138117 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-478b6c39-5e5f-403b-b1c7-0d1f05cd9a42 req-7e79dd6e-ed3b-4926-9cc0-b95e02fe0744 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:49.138592 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-478b6c39-5e5f-403b-b1c7-0d1f05cd9a42 req-7e79dd6e-ed3b-4926-9cc0-b95e02fe0744 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:49.139046 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-478b6c39-5e5f-403b-b1c7-0d1f05cd9a42 req-7e79dd6e-ed3b-4926-9cc0-b95e02fe0744 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:49.151001 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-478b6c39-5e5f-403b-b1c7-0d1f05cd9a42 req-7e79dd6e-ed3b-4926-9cc0-b95e02fe0744 service nova] Creating event network-changed:d190bfd0-e1fc-4a5c-9d6c-f84bdb6d2209 for instance f891147d-0b78-40f9-a17c-e1c9dbbc9f74 on hv-cinder-maste Oct 24 08:52:49.156811 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-478b6c39-5e5f-403b-b1c7-0d1f05cd9a42 req-7e79dd6e-ed3b-4926-9cc0-b95e02fe0744 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032971 Oct 24 08:52:49.157725 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 306/612] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:52:49.336442 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-0b92d748-b2be-444e-995a-a09b7f74c7e8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:49.345575 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-0b92d748-b2be-444e-995a-a09b7f74c7e8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487" status: 200 len: 1367 microversion: 2.1 time: 0.300503 Oct 24 08:52:49.346779 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 307/613] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:49 2022] GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487 => generated 1367 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:50.374704 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-789ec5d6-9a2e-49f4-a820-f734f2950870 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:50.375387 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-789ec5d6-9a2e-49f4-a820-f734f2950870 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 9ba684f7-ce77-465c-a6d7-7840517ef487] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:50.382420 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-789ec5d6-9a2e-49f4-a820-f734f2950870 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:50.382912 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-789ec5d6-9a2e-49f4-a820-f734f2950870 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:50.383393 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-789ec5d6-9a2e-49f4-a820-f734f2950870 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:50.384078 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-789ec5d6-9a2e-49f4-a820-f734f2950870 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:50.384651 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-789ec5d6-9a2e-49f4-a820-f734f2950870 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:50.385051 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-789ec5d6-9a2e-49f4-a820-f734f2950870 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:50.585270 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-789ec5d6-9a2e-49f4-a820-f734f2950870 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:50.593370 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-789ec5d6-9a2e-49f4-a820-f734f2950870 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487" status: 200 len: 1367 microversion: 2.1 time: 0.223590 Oct 24 08:52:50.593925 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 307/614] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:50 2022] GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:51.182374 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-49eb3bb8-06a0-4938-adc6-2568336435b0 req-24150ba2-c1fe-45b6-96a1-7e6c9682a1dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f891147d-0b78-40f9-a17c-e1c9dbbc9f74", "tag": "d190bfd0-e1fc-4a5c-9d6c-f84bdb6d2209"}, {"name": "network-changed", "server_uuid": "9ba684f7-ce77-465c-a6d7-7840517ef487", "tag": "1419fed7-a1ba-40a7-8adf-a4288addb6bf"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:51.198707 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-49eb3bb8-06a0-4938-adc6-2568336435b0 req-24150ba2-c1fe-45b6-96a1-7e6c9682a1dc service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:51.200148 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-49eb3bb8-06a0-4938-adc6-2568336435b0 req-24150ba2-c1fe-45b6-96a1-7e6c9682a1dc service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:51.202853 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-49eb3bb8-06a0-4938-adc6-2568336435b0 req-24150ba2-c1fe-45b6-96a1-7e6c9682a1dc service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:51.215538 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-49eb3bb8-06a0-4938-adc6-2568336435b0 req-24150ba2-c1fe-45b6-96a1-7e6c9682a1dc service nova] Creating event network-changed:d190bfd0-e1fc-4a5c-9d6c-f84bdb6d2209 for instance f891147d-0b78-40f9-a17c-e1c9dbbc9f74 on hv-cinder-maste Oct 24 08:52:51.216039 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-49eb3bb8-06a0-4938-adc6-2568336435b0 req-24150ba2-c1fe-45b6-96a1-7e6c9682a1dc service nova] Creating event network-changed:1419fed7-a1ba-40a7-8adf-a4288addb6bf for instance 9ba684f7-ce77-465c-a6d7-7840517ef487 on hv-cinder-maste Oct 24 08:52:51.222738 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-49eb3bb8-06a0-4938-adc6-2568336435b0 req-24150ba2-c1fe-45b6-96a1-7e6c9682a1dc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.046553 Oct 24 08:52:51.223315 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 308/615] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:52:51.692547 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-4a1451db-79ca-4976-bccf-c23e47e60c4c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:51.693160 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-4a1451db-79ca-4976-bccf-c23e47e60c4c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 9ba684f7-ce77-465c-a6d7-7840517ef487] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:51.695153 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:51.700320 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4a1451db-79ca-4976-bccf-c23e47e60c4c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:51.700806 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4a1451db-79ca-4976-bccf-c23e47e60c4c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:51.701246 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4a1451db-79ca-4976-bccf-c23e47e60c4c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:51.701934 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4a1451db-79ca-4976-bccf-c23e47e60c4c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:51.702386 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4a1451db-79ca-4976-bccf-c23e47e60c4c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:51.702815 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4a1451db-79ca-4976-bccf-c23e47e60c4c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:51.852113 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-4a1451db-79ca-4976-bccf-c23e47e60c4c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:51.860985 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-4a1451db-79ca-4976-bccf-c23e47e60c4c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487" status: 200 len: 1367 microversion: 2.1 time: 0.244293 Oct 24 08:52:51.861558 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 308/616] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:51 2022] GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487 => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:52.896554 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-f77e216d-9e47-4f98-9f50-b4e9a3e3614c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:52.897843 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-f77e216d-9e47-4f98-9f50-b4e9a3e3614c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 9ba684f7-ce77-465c-a6d7-7840517ef487] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:52.908428 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f77e216d-9e47-4f98-9f50-b4e9a3e3614c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:52.909218 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f77e216d-9e47-4f98-9f50-b4e9a3e3614c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:52.909945 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f77e216d-9e47-4f98-9f50-b4e9a3e3614c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:52.911146 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f77e216d-9e47-4f98-9f50-b4e9a3e3614c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:52.911883 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f77e216d-9e47-4f98-9f50-b4e9a3e3614c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:52.912581 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f77e216d-9e47-4f98-9f50-b4e9a3e3614c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:53.050866 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-f77e216d-9e47-4f98-9f50-b4e9a3e3614c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:53.059014 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-f77e216d-9e47-4f98-9f50-b4e9a3e3614c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487" status: 200 len: 1367 microversion: 2.1 time: 0.169827 Oct 24 08:52:53.059549 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 309/617] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:52 2022] GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:54.082069 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-eda75403-2e6b-4a0d-8503-035ee315ad1a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:54.082660 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-eda75403-2e6b-4a0d-8503-035ee315ad1a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 9ba684f7-ce77-465c-a6d7-7840517ef487] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:54.089614 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-eda75403-2e6b-4a0d-8503-035ee315ad1a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:54.090122 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-eda75403-2e6b-4a0d-8503-035ee315ad1a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:54.090550 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-eda75403-2e6b-4a0d-8503-035ee315ad1a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:54.091271 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-eda75403-2e6b-4a0d-8503-035ee315ad1a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:54.091693 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-eda75403-2e6b-4a0d-8503-035ee315ad1a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:54.092191 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-eda75403-2e6b-4a0d-8503-035ee315ad1a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:54.283235 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-eda75403-2e6b-4a0d-8503-035ee315ad1a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:54.283383 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:54.291570 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-eda75403-2e6b-4a0d-8503-035ee315ad1a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487" status: 200 len: 1367 microversion: 2.1 time: 0.213490 Oct 24 08:52:54.292137 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 309/618] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:54 2022] GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:55.315706 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-10f4c3b9-3562-4cdf-8b7b-44ccb598d371 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:55.316784 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-10f4c3b9-3562-4cdf-8b7b-44ccb598d371 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 9ba684f7-ce77-465c-a6d7-7840517ef487] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:55.324557 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-10f4c3b9-3562-4cdf-8b7b-44ccb598d371 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:55.325119 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-10f4c3b9-3562-4cdf-8b7b-44ccb598d371 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:55.325659 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-10f4c3b9-3562-4cdf-8b7b-44ccb598d371 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:55.326447 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-10f4c3b9-3562-4cdf-8b7b-44ccb598d371 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:55.327007 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-10f4c3b9-3562-4cdf-8b7b-44ccb598d371 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:55.327500 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-10f4c3b9-3562-4cdf-8b7b-44ccb598d371 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:55.710583 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-10f4c3b9-3562-4cdf-8b7b-44ccb598d371 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:55.718870 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-10f4c3b9-3562-4cdf-8b7b-44ccb598d371 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487" status: 200 len: 1367 microversion: 2.1 time: 0.407772 Oct 24 08:52:55.719546 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 310/619] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:55 2022] GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487 => generated 1367 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:56.746697 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-21ee26a7-d95f-4e6d-90ab-652904982780 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:56.747780 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-21ee26a7-d95f-4e6d-90ab-652904982780 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 9ba684f7-ce77-465c-a6d7-7840517ef487] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:56.750590 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell0:SELECT=2 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:56.751296 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell0:SELECT=6 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:56.757535 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-21ee26a7-d95f-4e6d-90ab-652904982780 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:56.758017 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-21ee26a7-d95f-4e6d-90ab-652904982780 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:56.758461 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-21ee26a7-d95f-4e6d-90ab-652904982780 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:56.759171 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-21ee26a7-d95f-4e6d-90ab-652904982780 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:56.759618 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-21ee26a7-d95f-4e6d-90ab-652904982780 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:56.760069 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-21ee26a7-d95f-4e6d-90ab-652904982780 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:56.887092 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-21ee26a7-d95f-4e6d-90ab-652904982780 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:56.895061 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-21ee26a7-d95f-4e6d-90ab-652904982780 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487" status: 200 len: 1367 microversion: 2.1 time: 0.155413 Oct 24 08:52:56.895623 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 310/620] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:56 2022] GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:57.655310 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-bcd02756-7947-4861-b918-b2efdc9db6b3 req-17ab56ff-c58a-4c24-859d-3d919051830d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ba684f7-ce77-465c-a6d7-7840517ef487", "name": "network-vif-plugged", "status": "completed", "tag": "1419fed7-a1ba-40a7-8adf-a4288addb6bf"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:52:57.660258 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell0:SELECT=6 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:57.666126 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-bcd02756-7947-4861-b918-b2efdc9db6b3 req-17ab56ff-c58a-4c24-859d-3d919051830d service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:57.666607 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-bcd02756-7947-4861-b918-b2efdc9db6b3 req-17ab56ff-c58a-4c24-859d-3d919051830d service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:57.667060 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-bcd02756-7947-4861-b918-b2efdc9db6b3 req-17ab56ff-c58a-4c24-859d-3d919051830d service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:57.678898 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-bcd02756-7947-4861-b918-b2efdc9db6b3 req-17ab56ff-c58a-4c24-859d-3d919051830d service nova] Creating event network-vif-plugged:1419fed7-a1ba-40a7-8adf-a4288addb6bf for instance 9ba684f7-ce77-465c-a6d7-7840517ef487 on hv-cinder-maste Oct 24 08:52:57.683892 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-bcd02756-7947-4861-b918-b2efdc9db6b3 req-17ab56ff-c58a-4c24-859d-3d919051830d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032520 Oct 24 08:52:57.684698 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 311/621] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:52:57.917854 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-e7e02630-44f5-4d01-90c0-c470c914e928 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:57.918464 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-e7e02630-44f5-4d01-90c0-c470c914e928 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 9ba684f7-ce77-465c-a6d7-7840517ef487] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:57.925520 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e7e02630-44f5-4d01-90c0-c470c914e928 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:57.925971 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e7e02630-44f5-4d01-90c0-c470c914e928 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:57.926418 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e7e02630-44f5-4d01-90c0-c470c914e928 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:57.927145 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e7e02630-44f5-4d01-90c0-c470c914e928 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:57.927583 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e7e02630-44f5-4d01-90c0-c470c914e928 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:57.927996 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e7e02630-44f5-4d01-90c0-c470c914e928 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:58.058651 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-e7e02630-44f5-4d01-90c0-c470c914e928 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:58.066799 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-e7e02630-44f5-4d01-90c0-c470c914e928 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487" status: 200 len: 1367 microversion: 2.1 time: 0.152852 Oct 24 08:52:58.067338 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 311/622] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:57 2022] GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:52:59.094639 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-920a4baa-9953-448d-ac29-ebff60b500b3 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:52:59.095504 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-920a4baa-9953-448d-ac29-ebff60b500b3 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 9ba684f7-ce77-465c-a6d7-7840517ef487] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:52:59.103027 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-920a4baa-9953-448d-ac29-ebff60b500b3 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:59.103588 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-920a4baa-9953-448d-ac29-ebff60b500b3 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:59.104088 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-920a4baa-9953-448d-ac29-ebff60b500b3 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:59.104888 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-920a4baa-9953-448d-ac29-ebff60b500b3 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:52:59.105412 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-920a4baa-9953-448d-ac29-ebff60b500b3 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:52:59.105902 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-920a4baa-9953-448d-ac29-ebff60b500b3 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:52:59.251420 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-920a4baa-9953-448d-ac29-ebff60b500b3 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:52:59.259173 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-920a4baa-9953-448d-ac29-ebff60b500b3 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487" status: 200 len: 1367 microversion: 2.1 time: 0.171535 Oct 24 08:52:59.259795 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 312/623] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:52:59 2022] GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:00.284640 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-05294efc-32bc-4b6c-9edb-aa9197d66801 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:00.285125 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-05294efc-32bc-4b6c-9edb-aa9197d66801 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 9ba684f7-ce77-465c-a6d7-7840517ef487] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:00.292152 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-05294efc-32bc-4b6c-9edb-aa9197d66801 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:00.292655 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-05294efc-32bc-4b6c-9edb-aa9197d66801 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:00.293084 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-05294efc-32bc-4b6c-9edb-aa9197d66801 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:00.293760 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-05294efc-32bc-4b6c-9edb-aa9197d66801 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:00.294543 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-05294efc-32bc-4b6c-9edb-aa9197d66801 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:00.294969 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-05294efc-32bc-4b6c-9edb-aa9197d66801 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:00.429573 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-05294efc-32bc-4b6c-9edb-aa9197d66801 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:00.437544 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-05294efc-32bc-4b6c-9edb-aa9197d66801 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487" status: 200 len: 1558 microversion: 2.1 time: 0.157120 Oct 24 08:53:00.438103 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 312/624] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:00 2022] GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:00.459962 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-6170c385-f6b5-484a-865b-24af547e6f02 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:00.460499 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-6170c385-f6b5-484a-865b-24af547e6f02 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 9ba684f7-ce77-465c-a6d7-7840517ef487] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:00.467081 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6170c385-f6b5-484a-865b-24af547e6f02 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:00.467568 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6170c385-f6b5-484a-865b-24af547e6f02 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:00.468038 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6170c385-f6b5-484a-865b-24af547e6f02 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:00.468907 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6170c385-f6b5-484a-865b-24af547e6f02 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:00.469368 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6170c385-f6b5-484a-865b-24af547e6f02 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:00.469791 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6170c385-f6b5-484a-865b-24af547e6f02 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:00.552864 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-6170c385-f6b5-484a-865b-24af547e6f02 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096400 Oct 24 08:53:00.553670 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 313/625] 10.222.0.26 () {58 vars in 1275 bytes} [Mon Oct 24 08:53:00 2022] GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:00.856120 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-af093d16-e083-4d17-9262-cfacfefeb9fa tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:00.856635 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-af093d16-e083-4d17-9262-cfacfefeb9fa tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:00.862750 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-af093d16-e083-4d17-9262-cfacfefeb9fa tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:00.863246 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-af093d16-e083-4d17-9262-cfacfefeb9fa tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:00.863681 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-af093d16-e083-4d17-9262-cfacfefeb9fa tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:00.864369 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-af093d16-e083-4d17-9262-cfacfefeb9fa tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:00.864815 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-af093d16-e083-4d17-9262-cfacfefeb9fa tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:00.865234 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-af093d16-e083-4d17-9262-cfacfefeb9fa tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:00.895782 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-af093d16-e083-4d17-9262-cfacfefeb9fa tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e/os-volume_attachments/847a11f9-aec6-4b79-86ff-64e7465c3798" status: 200 len: 194 microversion: 2.20 time: 0.145918 Oct 24 08:53:00.896339 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 313/626] 10.222.0.26 () {60 vars in 1454 bytes} [Mon Oct 24 08:53:00 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e/os-volume_attachments/847a11f9-aec6-4b79-86ff-64e7465c3798 => generated 194 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:53:00.966189 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-ec44d9c5-7faf-43d2-8d23-e650e6531ef6 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:00.966681 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-ec44d9c5-7faf-43d2-8d23-e650e6531ef6 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:00.973009 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ec44d9c5-7faf-43d2-8d23-e650e6531ef6 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:00.973471 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ec44d9c5-7faf-43d2-8d23-e650e6531ef6 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:00.973986 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ec44d9c5-7faf-43d2-8d23-e650e6531ef6 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:00.974600 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ec44d9c5-7faf-43d2-8d23-e650e6531ef6 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:00.975107 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ec44d9c5-7faf-43d2-8d23-e650e6531ef6 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:00.975497 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ec44d9c5-7faf-43d2-8d23-e650e6531ef6 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:01.060066 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.objects.instance [None req-ec44d9c5-7faf-43d2-8d23-e650e6531ef6 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lazy-loading 'services' on Instance uuid cf8e51c6-99cf-49c6-b25b-89c3c7045e4e {{(pid=125165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:53:01.141695 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-ec44d9c5-7faf-43d2-8d23-e650e6531ef6 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e/os-volume_attachments/847a11f9-aec6-4b79-86ff-64e7465c3798" status: 202 len: 0 microversion: 2.20 time: 0.179384 Oct 24 08:53:01.142364 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 314/627] 10.222.0.26 () {60 vars in 1457 bytes} [Mon Oct 24 08:53:00 2022] DELETE /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e/os-volume_attachments/847a11f9-aec6-4b79-86ff-64e7465c3798 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:53:01.151131 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-445804f0-29bc-4517-abcf-a45220550297 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:01.153479 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-445804f0-29bc-4517-abcf-a45220550297 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:01.160175 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-445804f0-29bc-4517-abcf-a45220550297 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:01.160762 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-445804f0-29bc-4517-abcf-a45220550297 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:01.161296 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-445804f0-29bc-4517-abcf-a45220550297 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:01.162187 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-445804f0-29bc-4517-abcf-a45220550297 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:01.163089 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-445804f0-29bc-4517-abcf-a45220550297 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:01.163676 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-445804f0-29bc-4517-abcf-a45220550297 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:01.200529 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-445804f0-29bc-4517-abcf-a45220550297 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053489 Oct 24 08:53:01.201092 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 314/628] 10.222.0.26 () {60 vars in 1343 bytes} [Mon Oct 24 08:53:01 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:53:01.524611 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-f5265ffb-7625-4681-acd3-2bbd06b884e3 req-524ddc01-752e-4532-9af2-b5a170db2167 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ba684f7-ce77-465c-a6d7-7840517ef487", "tag": "1419fed7-a1ba-40a7-8adf-a4288addb6bf"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:01.534578 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-f5265ffb-7625-4681-acd3-2bbd06b884e3 req-524ddc01-752e-4532-9af2-b5a170db2167 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:01.535136 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-f5265ffb-7625-4681-acd3-2bbd06b884e3 req-524ddc01-752e-4532-9af2-b5a170db2167 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:01.535570 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-f5265ffb-7625-4681-acd3-2bbd06b884e3 req-524ddc01-752e-4532-9af2-b5a170db2167 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:01.546964 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-f5265ffb-7625-4681-acd3-2bbd06b884e3 req-524ddc01-752e-4532-9af2-b5a170db2167 service nova] Creating event network-changed:1419fed7-a1ba-40a7-8adf-a4288addb6bf for instance 9ba684f7-ce77-465c-a6d7-7840517ef487 on hv-cinder-maste Oct 24 08:53:01.551998 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-f5265ffb-7625-4681-acd3-2bbd06b884e3 req-524ddc01-752e-4532-9af2-b5a170db2167 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031446 Oct 24 08:53:01.552600 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 315/629] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:02.213932 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-e8ceafaa-6601-45fe-b644-70ca6208bef9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:02.216361 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-e8ceafaa-6601-45fe-b644-70ca6208bef9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:02.226531 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e8ceafaa-6601-45fe-b644-70ca6208bef9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:02.227416 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e8ceafaa-6601-45fe-b644-70ca6208bef9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:02.228312 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e8ceafaa-6601-45fe-b644-70ca6208bef9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:02.229349 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e8ceafaa-6601-45fe-b644-70ca6208bef9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:02.229987 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e8ceafaa-6601-45fe-b644-70ca6208bef9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:02.230700 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e8ceafaa-6601-45fe-b644-70ca6208bef9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:02.270633 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-e8ceafaa-6601-45fe-b644-70ca6208bef9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056278 Oct 24 08:53:02.276015 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 315/630] 10.222.0.26 () {60 vars in 1343 bytes} [Mon Oct 24 08:53:02 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:53:03.285522 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-006275ce-6b3f-419a-b006-e68258999f4e tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:03.287364 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-006275ce-6b3f-419a-b006-e68258999f4e tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:03.293821 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-006275ce-6b3f-419a-b006-e68258999f4e tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:03.294618 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-006275ce-6b3f-419a-b006-e68258999f4e tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:03.295125 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-006275ce-6b3f-419a-b006-e68258999f4e tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:03.295807 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-006275ce-6b3f-419a-b006-e68258999f4e tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:03.296252 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-006275ce-6b3f-419a-b006-e68258999f4e tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:03.296660 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-006275ce-6b3f-419a-b006-e68258999f4e tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:03.326943 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-006275ce-6b3f-419a-b006-e68258999f4e tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046168 Oct 24 08:53:03.327496 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 316/631] 10.222.0.26 () {60 vars in 1343 bytes} [Mon Oct 24 08:53:03 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:03.391161 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-598a482d-2fe9-4a97-9bfe-a32734a2f102 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:03.391697 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-598a482d-2fe9-4a97-9bfe-a32734a2f102 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:03.398458 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-598a482d-2fe9-4a97-9bfe-a32734a2f102 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:03.398982 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-598a482d-2fe9-4a97-9bfe-a32734a2f102 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:03.399419 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-598a482d-2fe9-4a97-9bfe-a32734a2f102 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:03.400107 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-598a482d-2fe9-4a97-9bfe-a32734a2f102 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:03.400558 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-598a482d-2fe9-4a97-9bfe-a32734a2f102 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:03.400985 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-598a482d-2fe9-4a97-9bfe-a32734a2f102 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:03.428385 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-598a482d-2fe9-4a97-9bfe-a32734a2f102 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Going to try to terminate instance {{(pid=125164) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:53:03.508607 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-598a482d-2fe9-4a97-9bfe-a32734a2f102 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 204 len: 0 microversion: 2.20 time: 0.121074 Oct 24 08:53:03.509660 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 316/632] 10.222.0.26 () {60 vars in 1280 bytes} [Mon Oct 24 08:53:03 2022] DELETE /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 08:53:03.517908 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-77d6c600-c5d0-403d-987a-d8738aa6a0ca tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:03.518557 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-77d6c600-c5d0-403d-987a-d8738aa6a0ca tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:03.525163 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-77d6c600-c5d0-403d-987a-d8738aa6a0ca tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:03.525687 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-77d6c600-c5d0-403d-987a-d8738aa6a0ca tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:03.526143 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-77d6c600-c5d0-403d-987a-d8738aa6a0ca tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:03.526848 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-77d6c600-c5d0-403d-987a-d8738aa6a0ca tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:03.527300 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-77d6c600-c5d0-403d-987a-d8738aa6a0ca tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:03.527718 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-77d6c600-c5d0-403d-987a-d8738aa6a0ca tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:03.665067 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-77d6c600-c5d0-403d-987a-d8738aa6a0ca tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:03.673803 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-77d6c600-c5d0-403d-987a-d8738aa6a0ca tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:03.675253 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-77d6c600-c5d0-403d-987a-d8738aa6a0ca tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:03.676400 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-77d6c600-c5d0-403d-987a-d8738aa6a0ca tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1723 microversion: 2.20 time: 0.162555 Oct 24 08:53:03.676956 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 317/633] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:03 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:53:04.705639 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-7ac9df2f-f907-46a1-b682-1d9e177d512d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:04.706461 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-7ac9df2f-f907-46a1-b682-1d9e177d512d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:04.714287 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7ac9df2f-f907-46a1-b682-1d9e177d512d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:04.714909 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7ac9df2f-f907-46a1-b682-1d9e177d512d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:04.715393 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7ac9df2f-f907-46a1-b682-1d9e177d512d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:04.716238 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7ac9df2f-f907-46a1-b682-1d9e177d512d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:04.716768 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7ac9df2f-f907-46a1-b682-1d9e177d512d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:04.717262 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7ac9df2f-f907-46a1-b682-1d9e177d512d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:04.853821 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-7ac9df2f-f907-46a1-b682-1d9e177d512d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:04.866705 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-7ac9df2f-f907-46a1-b682-1d9e177d512d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:04.868954 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-7ac9df2f-f907-46a1-b682-1d9e177d512d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:04.870787 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-7ac9df2f-f907-46a1-b682-1d9e177d512d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1723 microversion: 2.20 time: 0.172073 Oct 24 08:53:04.871890 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 317/634] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:04 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:05.902077 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-03425610-30b1-47dc-9b35-c695c63ad6c8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:05.903124 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-03425610-30b1-47dc-9b35-c695c63ad6c8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:05.913528 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-03425610-30b1-47dc-9b35-c695c63ad6c8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:05.914267 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-03425610-30b1-47dc-9b35-c695c63ad6c8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:05.915057 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-03425610-30b1-47dc-9b35-c695c63ad6c8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:05.916183 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-03425610-30b1-47dc-9b35-c695c63ad6c8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:05.916931 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-03425610-30b1-47dc-9b35-c695c63ad6c8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:05.917632 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-03425610-30b1-47dc-9b35-c695c63ad6c8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:06.133952 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-03425610-30b1-47dc-9b35-c695c63ad6c8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:06.142264 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-03425610-30b1-47dc-9b35-c695c63ad6c8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:06.143730 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-03425610-30b1-47dc-9b35-c695c63ad6c8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:06.144913 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-03425610-30b1-47dc-9b35-c695c63ad6c8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1723 microversion: 2.20 time: 0.249403 Oct 24 08:53:06.145468 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 318/635] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:05 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:06.860036 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-939d122c-f6a6-4ab8-b176-bdca3fa7a538 req-989cbfe9-f476-46ee-8c18-8d3855329f5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf8e51c6-99cf-49c6-b25b-89c3c7045e4e", "name": "network-vif-deleted", "tag": "c7a98c12-528e-4bbb-9ae8-1c8aaf7fbba9"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:06.872039 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-939d122c-f6a6-4ab8-b176-bdca3fa7a538 req-989cbfe9-f476-46ee-8c18-8d3855329f5a service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:06.872509 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-939d122c-f6a6-4ab8-b176-bdca3fa7a538 req-989cbfe9-f476-46ee-8c18-8d3855329f5a service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:06.872930 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-939d122c-f6a6-4ab8-b176-bdca3fa7a538 req-989cbfe9-f476-46ee-8c18-8d3855329f5a service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:06.891250 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-939d122c-f6a6-4ab8-b176-bdca3fa7a538 req-989cbfe9-f476-46ee-8c18-8d3855329f5a service nova] Creating event network-vif-deleted:c7a98c12-528e-4bbb-9ae8-1c8aaf7fbba9 for instance cf8e51c6-99cf-49c6-b25b-89c3c7045e4e on hv-cinder-maste Oct 24 08:53:06.896948 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-939d122c-f6a6-4ab8-b176-bdca3fa7a538 req-989cbfe9-f476-46ee-8c18-8d3855329f5a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041023 Oct 24 08:53:06.897960 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 318/636] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:07.169785 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-4becdf35-ac3a-4226-8fe9-9998c6ccee88 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:07.170456 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-4becdf35-ac3a-4226-8fe9-9998c6ccee88 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:07.177105 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4becdf35-ac3a-4226-8fe9-9998c6ccee88 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:07.177568 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4becdf35-ac3a-4226-8fe9-9998c6ccee88 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:07.178008 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4becdf35-ac3a-4226-8fe9-9998c6ccee88 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:07.178820 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4becdf35-ac3a-4226-8fe9-9998c6ccee88 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:07.179259 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4becdf35-ac3a-4226-8fe9-9998c6ccee88 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:07.179812 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4becdf35-ac3a-4226-8fe9-9998c6ccee88 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:07.211497 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4becdf35-ac3a-4226-8fe9-9998c6ccee88 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:07.212167 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4becdf35-ac3a-4226-8fe9-9998c6ccee88 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:07.212601 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4becdf35-ac3a-4226-8fe9-9998c6ccee88 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:07.213159 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.objects.instance [None req-4becdf35-ac3a-4226-8fe9-9998c6ccee88 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lazy-loading 'fault' on Instance uuid cf8e51c6-99cf-49c6-b25b-89c3c7045e4e {{(pid=125165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:53:07.255465 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-4becdf35-ac3a-4226-8fe9-9998c6ccee88 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:07.263721 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-4becdf35-ac3a-4226-8fe9-9998c6ccee88 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:07.265140 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-4becdf35-ac3a-4226-8fe9-9998c6ccee88 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:07.270157 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-4becdf35-ac3a-4226-8fe9-9998c6ccee88 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 200 len: 1371 microversion: 2.20 time: 0.101266 Oct 24 08:53:07.270157 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 319/637] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:07 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 1371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:08.298800 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-607e5769-ddcc-430b-8520-f0d83b7c744c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:08.299505 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-607e5769-ddcc-430b-8520-f0d83b7c744c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:08.306114 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-607e5769-ddcc-430b-8520-f0d83b7c744c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:08.306599 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-607e5769-ddcc-430b-8520-f0d83b7c744c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:08.307065 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-607e5769-ddcc-430b-8520-f0d83b7c744c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:08.307755 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-607e5769-ddcc-430b-8520-f0d83b7c744c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:08.308202 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-607e5769-ddcc-430b-8520-f0d83b7c744c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:08.308628 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-607e5769-ddcc-430b-8520-f0d83b7c744c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:08.321976 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.wsgi [None req-607e5769-ddcc-430b-8520-f0d83b7c744c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] HTTP exception thrown: Instance cf8e51c6-99cf-49c6-b25b-89c3c7045e4e could not be found. Oct 24 08:53:08.323787 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-607e5769-ddcc-430b-8520-f0d83b7c744c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Request method failure captured: Oct 24 08:53:08.323787 dv-cinder-master-3-smb devstack@n-api.service[125164]: request: GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e HTTP/1.1 Oct 24 08:53:08.323787 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept: application/json Oct 24 08:53:08.323787 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept-Encoding: identity Oct 24 08:53:08.323787 dv-cinder-master-3-smb devstack@n-api.service[125164]: Connection: close Oct 24 08:53:08.323787 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Length: 0 Oct 24 08:53:08.323787 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Type: application/json Oct 24 08:53:08.323787 dv-cinder-master-3-smb devstack@n-api.service[125164]: Host: 10.222.0.26 Oct 24 08:53:08.323787 dv-cinder-master-3-smb devstack@n-api.service[125164]: Openstack-System-Scope: None Oct 24 08:53:08.323787 dv-cinder-master-3-smb devstack@n-api.service[125164]: User-Agent: python-urllib3/1.26.12 Oct 24 08:53:08.323787 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Auth-Token: gAAAAABjVlE9aCQ2ngbo3b7nJ6ZGeJTAG-wCQeUxjg1cUuyWWmpWzwmJrK40UyCA6n1ENMQcQ7n_9uAhNCH5AwZNFjQ3GJaDLdyvaFaxypjoVbX2AU6DS4_0a8UCylR05rHmIJT9J7p0dUD8pQbSHMSONZCPcs4qIDXr6BS2AIkdwIBH4WGLMqQ Oct 24 08:53:08.323787 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Id: None Oct 24 08:53:08.323787 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Name: None Oct 24 08:53:08.323787 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Identity-Status: Confirmed Oct 24 08:53:08.323787 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Is-Admin-Project: True Oct 24 08:53:08.323787 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Openstack-Nova-Api-Version: 2.20 Oct 24 08:53:08.323787 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Id: default Oct 24 08:53:08.323787 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Name: Default Oct 24 08:53:08.323787 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Id: 5bca750f880a44988f7324b2f8da3e7b Oct 24 08:53:08.323787 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2140536292 Oct 24 08:53:08.323787 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Role: reader,member Oct 24 08:53:08.323787 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Roles: reader,member Oct 24 08:53:08.325455 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5bca750f880a44988f7324b2f8da3e7b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5bca750f880a44988f7324b2f8da3e7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5bca750f880a44988f7324b2f8da3e7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5bca750f880a44988f7324b2f8da3e7b"}]}] Oct 24 08:53:08.325455 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2140536292 Oct 24 08:53:08.325455 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Id: 5bca750f880a44988f7324b2f8da3e7b Oct 24 08:53:08.325455 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2140536292 Oct 24 08:53:08.325455 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User: tempest-AttachVolumeShelveTestJSON-2140536292-project Oct 24 08:53:08.325455 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Id: default Oct 24 08:53:08.325455 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Name: Default Oct 24 08:53:08.325455 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Id: 43af1b9b66804624aff6eef2f435d581 Oct 24 08:53:08.325455 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2140536292-project Oct 24 08:53:08.325455 dv-cinder-master-3-smb devstack@n-api.service[125164]: method: > Oct 24 08:53:08.325455 dv-cinder-master-3-smb devstack@n-api.service[125164]: exception: Instance cf8e51c6-99cf-49c6-b25b-89c3c7045e4e could not be found. Oct 24 08:53:08.325455 dv-cinder-master-3-smb devstack@n-api.service[125164]: action_args: {'id': 'cf8e51c6-99cf-49c6-b25b-89c3c7045e4e'} Oct 24 08:53:08.326285 dv-cinder-master-3-smb devstack@n-api.service[125164]: {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:53:08.326285 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:08.326285 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:53:08.326285 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:53:08.326285 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:53:08.326285 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:53:08.326285 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:53:08.326285 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:53:08.326285 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:53:08.326285 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:53:08.326285 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf8e51c6-99cf-49c6-b25b-89c3c7045e4e could not be found. Oct 24 08:53:08.326285 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:53:08.326285 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:53:08.326285 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:53:08.326285 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:08.326285 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:53:08.326285 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:53:08.326285 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:53:08.326285 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:53:08.326285 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:53:08.327542 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:53:08.327542 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:53:08.327542 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:53:08.327542 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:53:08.327542 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:53:08.327542 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:53:08.327542 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:53:08.327542 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf8e51c6-99cf-49c6-b25b-89c3c7045e4e could not be found. Oct 24 08:53:08.327542 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:53:08.327542 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:53:08.327542 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:53:08.327542 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:08.327542 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:53:08.327542 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:53:08.327542 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:53:08.327542 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:53:08.327542 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf8e51c6-99cf-49c6-b25b-89c3c7045e4e could not be found. Oct 24 08:53:08.327542 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:53:08.328610 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-607e5769-ddcc-430b-8520-f0d83b7c744c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Returning 404 to user: Instance cf8e51c6-99cf-49c6-b25b-89c3c7045e4e could not be found. {{(pid=125164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:53:08.328610 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-607e5769-ddcc-430b-8520-f0d83b7c744c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 404 len: 111 microversion: 2.20 time: 0.035128 Oct 24 08:53:08.328610 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 319/638] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:08 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 08:53:08.334708 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-1cba5411-938a-452a-af32-b85fba04bb3a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '.version_select at 0x7f7ef1698b80>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:08.357188 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-1cba5411-938a-452a-af32-b85fba04bb3a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1859003343" status: 204 len: 0 microversion: 2.20 time: 0.026443 Oct 24 08:53:08.357741 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 320/639] 10.222.0.26 () {60 vars in 1262 bytes} [Mon Oct 24 08:53:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1859003343 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 08:53:08.988620 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-27150fb2-51c5-41aa-ac4e-7a093a0bfcd0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Action: 'create', calling method: .version_select at 0x7f7ef139ddc0>, body: {"keypair": {"name": "tempest-keypair-1548869952", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMukkuWd1rP4ffmPr5c/zOtUBA+Ik6s5dC/5Ioj9ddPg8LF9p1EFNLmAm2AM256ve8B3EUww09Y0LnQQcKnkuLwVyhpcN/gyKKSHIruh1qTCHpVVhCRfXa57EpRDLxOQQ=="}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:09.003927 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.quota [None req-27150fb2-51c5-41aa-ac4e-7a093a0bfcd0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Getting quotas for project 5bca750f880a44988f7324b2f8da3e7b. Resources: {'key_pairs'} {{(pid=125164) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:53:09.007990 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.quota [None req-27150fb2-51c5-41aa-ac4e-7a093a0bfcd0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Getting quotas for user 43af1b9b66804624aff6eef2f435d581 and project 5bca750f880a44988f7324b2f8da3e7b. Resources: {'key_pairs'} {{(pid=125164) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:53:09.035291 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-27150fb2-51c5-41aa-ac4e-7a093a0bfcd0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.050298 Oct 24 08:53:09.036203 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 320/640] 10.222.0.26 () {62 vars in 1200 bytes} [Mon Oct 24 08:53:08 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 24 08:53:10.288340 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-bd88d92f-4534-49fe-8cbe-7a078016f2ab tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1809885192", "imageRef": "7eef2d62-12dc-4746-9cbd-870797d39b4d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "727ab62e-2508-4fac-97c2-cc662889b0bb"}], "security_groups": [{"name": "tempest-securitygroup--1114039321"}], "key_name": "tempest-keypair-1548869952", "user_data": "}} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:10.403780 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.network.neutron [None req-bd88d92f-4534-49fe-8cbe-7a078016f2ab tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] validate_networks() for [('727ab62e-2508-4fac-97c2-cc662889b0bb', None, None, None, None, None)] {{(pid=125165) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:53:11.074899 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-bd88d92f-4534-49fe-8cbe-7a078016f2ab tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Flavor limits 0:0:0 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:53:11.075318 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-bd88d92f-4534-49fe-8cbe-7a078016f2ab tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Image limits 0:0:0 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:53:11.075782 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-bd88d92f-4534-49fe-8cbe-7a078016f2ab tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Flavor pref 0:0:0 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:53:11.076179 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-bd88d92f-4534-49fe-8cbe-7a078016f2ab tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Image pref 0:0:0 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:53:11.076578 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-bd88d92f-4534-49fe-8cbe-7a078016f2ab tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:53:11.086318 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bd88d92f-4534-49fe-8cbe-7a078016f2ab tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:11.086799 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bd88d92f-4534-49fe-8cbe-7a078016f2ab tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:11.087227 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bd88d92f-4534-49fe-8cbe-7a078016f2ab tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:11.087942 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bd88d92f-4534-49fe-8cbe-7a078016f2ab tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:11.088416 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bd88d92f-4534-49fe-8cbe-7a078016f2ab tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:11.088830 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bd88d92f-4534-49fe-8cbe-7a078016f2ab tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:11.105528 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.quota [None req-bd88d92f-4534-49fe-8cbe-7a078016f2ab tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Getting quotas for project 5bca750f880a44988f7324b2f8da3e7b. Resources: {'ram', 'cores', 'instances'} {{(pid=125165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:53:11.109471 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.quota [None req-bd88d92f-4534-49fe-8cbe-7a078016f2ab tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Getting quotas for user 43af1b9b66804624aff6eef2f435d581 and project 5bca750f880a44988f7324b2f8da3e7b. Resources: {'ram', 'cores', 'instances'} {{(pid=125165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:53:11.120383 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-bd88d92f-4534-49fe-8cbe-7a078016f2ab tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Going to run 1 instances... {{(pid=125165) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:53:11.122649 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-bd88d92f-4534-49fe-8cbe-7a078016f2ab tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7eef2d62-12dc-4746-9cbd-870797d39b4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125165) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:53:11.176974 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-bd88d92f-4534-49fe-8cbe-7a078016f2ab tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.893069 Oct 24 08:53:11.183856 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 321/641] 10.222.0.26 () {62 vars in 1188 bytes} [Mon Oct 24 08:53:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 24 08:53:11.189707 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-8a4de8d7-aac3-4df2-985f-fe7ce63e66a7 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:11.190328 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-8a4de8d7-aac3-4df2-985f-fe7ce63e66a7 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:11.248757 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-8a4de8d7-aac3-4df2-985f-fe7ce63e66a7 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:11.256475 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-8a4de8d7-aac3-4df2-985f-fe7ce63e66a7 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:11.257886 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-8a4de8d7-aac3-4df2-985f-fe7ce63e66a7 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:11.259041 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-8a4de8d7-aac3-4df2-985f-fe7ce63e66a7 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1282 microversion: 2.20 time: 0.073807 Oct 24 08:53:11.259576 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 321/642] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:11 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1282 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:11.784652 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-8b07c340-97e3-40c8-a793-08980ecaae79 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-180164636"}} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:11.785242 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-8b07c340-97e3-40c8-a793-08980ecaae79 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:11.791260 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8b07c340-97e3-40c8-a793-08980ecaae79 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:11.791747 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8b07c340-97e3-40c8-a793-08980ecaae79 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:11.792181 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8b07c340-97e3-40c8-a793-08980ecaae79 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:11.792869 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8b07c340-97e3-40c8-a793-08980ecaae79 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:11.793318 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8b07c340-97e3-40c8-a793-08980ecaae79 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:11.793737 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8b07c340-97e3-40c8-a793-08980ecaae79 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:11.922408 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.network.security_group_api [None req-8b07c340-97e3-40c8-a793-08980ecaae79 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Removing security group 64d01f25-22d2-4536-aabd-015a84643967 from port 5693bb11-79fc-4a3c-bc79-8cc96cab3b00 Oct 24 08:53:12.241127 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-8b07c340-97e3-40c8-a793-08980ecaae79 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "POST /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1/action" status: 202 len: 0 microversion: 2.1 time: 0.460561 Oct 24 08:53:12.241816 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 322/643] 10.222.0.26 () {60 vars in 1278 bytes} [Mon Oct 24 08:53:11 2022] POST /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1/action => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:53:12.250250 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-3d81f448-1d13-4cec-912a-01d70f0c1872 req-f4c4e400-a9ee-42cc-8d0e-9f0a026d5bdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89a67761-1e03-4ede-8f59-f719d6ea20d1", "tag": "5693bb11-79fc-4a3c-bc79-8cc96cab3b00"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:12.260174 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-3d81f448-1d13-4cec-912a-01d70f0c1872 req-f4c4e400-a9ee-42cc-8d0e-9f0a026d5bdb service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:12.260654 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-3d81f448-1d13-4cec-912a-01d70f0c1872 req-f4c4e400-a9ee-42cc-8d0e-9f0a026d5bdb service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:12.261086 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-3d81f448-1d13-4cec-912a-01d70f0c1872 req-f4c4e400-a9ee-42cc-8d0e-9f0a026d5bdb service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:12.274411 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-3d81f448-1d13-4cec-912a-01d70f0c1872 req-f4c4e400-a9ee-42cc-8d0e-9f0a026d5bdb service nova] Creating event network-changed:5693bb11-79fc-4a3c-bc79-8cc96cab3b00 for instance 89a67761-1e03-4ede-8f59-f719d6ea20d1 on hv-cinder-maste Oct 24 08:53:12.282981 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-3d81f448-1d13-4cec-912a-01d70f0c1872 req-f4c4e400-a9ee-42cc-8d0e-9f0a026d5bdb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036080 Oct 24 08:53:12.284829 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 322/644] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:12.288978 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-a72fb364-fa38-47f1-bb52-04c7dd603c6b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:12.289586 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-a72fb364-fa38-47f1-bb52-04c7dd603c6b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:12.297687 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a72fb364-fa38-47f1-bb52-04c7dd603c6b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:12.299515 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a72fb364-fa38-47f1-bb52-04c7dd603c6b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:12.300700 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a72fb364-fa38-47f1-bb52-04c7dd603c6b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:12.302623 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a72fb364-fa38-47f1-bb52-04c7dd603c6b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:12.303290 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a72fb364-fa38-47f1-bb52-04c7dd603c6b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:12.303911 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a72fb364-fa38-47f1-bb52-04c7dd603c6b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:12.369493 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a72fb364-fa38-47f1-bb52-04c7dd603c6b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:12.378265 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a72fb364-fa38-47f1-bb52-04c7dd603c6b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:12.379756 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a72fb364-fa38-47f1-bb52-04c7dd603c6b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:12.380871 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-a72fb364-fa38-47f1-bb52-04c7dd603c6b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1334 microversion: 2.20 time: 0.095992 Oct 24 08:53:12.381436 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 323/645] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:12 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1334 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:13.406325 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-c34a6432-9a87-465f-af71-0ac851169bea tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:13.408329 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-c34a6432-9a87-465f-af71-0ac851169bea tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:13.415232 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c34a6432-9a87-465f-af71-0ac851169bea tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:13.415728 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c34a6432-9a87-465f-af71-0ac851169bea tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:13.416163 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c34a6432-9a87-465f-af71-0ac851169bea tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:13.416859 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c34a6432-9a87-465f-af71-0ac851169bea tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:13.417481 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c34a6432-9a87-465f-af71-0ac851169bea tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:13.418055 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c34a6432-9a87-465f-af71-0ac851169bea tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:13.613101 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-c34a6432-9a87-465f-af71-0ac851169bea tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:13.621722 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-c34a6432-9a87-465f-af71-0ac851169bea tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:13.623662 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-c34a6432-9a87-465f-af71-0ac851169bea tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:13.625148 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-c34a6432-9a87-465f-af71-0ac851169bea tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1408 microversion: 2.20 time: 0.223290 Oct 24 08:53:13.625921 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 323/646] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:13 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1408 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:13.760129 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-896c8ae6-51d7-47c9-bb98-faf639a2a791 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:13.760881 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-896c8ae6-51d7-47c9-bb98-faf639a2a791 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:13.766947 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-896c8ae6-51d7-47c9-bb98-faf639a2a791 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:13.767466 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-896c8ae6-51d7-47c9-bb98-faf639a2a791 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:13.767897 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-896c8ae6-51d7-47c9-bb98-faf639a2a791 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:13.768836 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-896c8ae6-51d7-47c9-bb98-faf639a2a791 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:13.769503 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-896c8ae6-51d7-47c9-bb98-faf639a2a791 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:13.770146 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-896c8ae6-51d7-47c9-bb98-faf639a2a791 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:13.786691 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:13.857765 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.objects.instance [None req-896c8ae6-51d7-47c9-bb98-faf639a2a791 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lazy-loading 'services' on Instance uuid 89a67761-1e03-4ede-8f59-f719d6ea20d1 {{(pid=125165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:53:13.939959 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-896c8ae6-51d7-47c9-bb98-faf639a2a791 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "DELETE /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1/os-volume_attachments/a9463451-a0d9-48de-9a2e-d79819875aa5" status: 202 len: 0 microversion: 2.1 time: 0.183569 Oct 24 08:53:13.940882 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 324/647] 10.222.0.26 () {58 vars in 1416 bytes} [Mon Oct 24 08:53:13 2022] DELETE /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1/os-volume_attachments/a9463451-a0d9-48de-9a2e-d79819875aa5 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:53:13.949569 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-294eab75-f56f-40bc-b02e-5917798307e2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:13.952233 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-294eab75-f56f-40bc-b02e-5917798307e2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:13.958756 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-294eab75-f56f-40bc-b02e-5917798307e2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:13.959628 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-294eab75-f56f-40bc-b02e-5917798307e2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:13.960460 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-294eab75-f56f-40bc-b02e-5917798307e2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:13.961463 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-294eab75-f56f-40bc-b02e-5917798307e2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:13.962259 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-294eab75-f56f-40bc-b02e-5917798307e2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:13.962824 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-294eab75-f56f-40bc-b02e-5917798307e2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:13.999797 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-294eab75-f56f-40bc-b02e-5917798307e2 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054469 Oct 24 08:53:14.000591 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 324/648] 10.222.0.26 () {58 vars in 1302 bytes} [Mon Oct 24 08:53:13 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:14.298963 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-61a332ae-0a44-45e2-8ff7-5ba6abeb174f req-9c3fc085-546d-4a25-88a8-64426be62744 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89a67761-1e03-4ede-8f59-f719d6ea20d1", "tag": "5693bb11-79fc-4a3c-bc79-8cc96cab3b00"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:14.308388 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-61a332ae-0a44-45e2-8ff7-5ba6abeb174f req-9c3fc085-546d-4a25-88a8-64426be62744 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:14.308877 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-61a332ae-0a44-45e2-8ff7-5ba6abeb174f req-9c3fc085-546d-4a25-88a8-64426be62744 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:14.309328 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-61a332ae-0a44-45e2-8ff7-5ba6abeb174f req-9c3fc085-546d-4a25-88a8-64426be62744 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:14.314550 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-83dc98e4-fefa-458c-ab08-e390e19e2c4d req-75bc861f-9912-46e8-b21d-209496cf547f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa2753cf-624f-4bf1-b85b-0fef0e35521c", "tag": "8db8d394-e903-4fe4-92d4-9750c49eb4c4"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:14.322320 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-61a332ae-0a44-45e2-8ff7-5ba6abeb174f req-9c3fc085-546d-4a25-88a8-64426be62744 service nova] Creating event network-changed:5693bb11-79fc-4a3c-bc79-8cc96cab3b00 for instance 89a67761-1e03-4ede-8f59-f719d6ea20d1 on hv-cinder-maste Oct 24 08:53:14.325998 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-83dc98e4-fefa-458c-ab08-e390e19e2c4d req-75bc861f-9912-46e8-b21d-209496cf547f service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:14.326586 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-83dc98e4-fefa-458c-ab08-e390e19e2c4d req-75bc861f-9912-46e8-b21d-209496cf547f service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:14.327131 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-83dc98e4-fefa-458c-ab08-e390e19e2c4d req-75bc861f-9912-46e8-b21d-209496cf547f service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:14.327338 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-61a332ae-0a44-45e2-8ff7-5ba6abeb174f req-9c3fc085-546d-4a25-88a8-64426be62744 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032470 Oct 24 08:53:14.328150 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 325/649] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:14.340533 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-83dc98e4-fefa-458c-ab08-e390e19e2c4d req-75bc861f-9912-46e8-b21d-209496cf547f service nova] Creating event network-changed:8db8d394-e903-4fe4-92d4-9750c49eb4c4 for instance aa2753cf-624f-4bf1-b85b-0fef0e35521c on hv-cinder-maste Oct 24 08:53:14.345224 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-83dc98e4-fefa-458c-ab08-e390e19e2c4d req-75bc861f-9912-46e8-b21d-209496cf547f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111193 Oct 24 08:53:14.345830 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 325/650] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:14.652888 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-39cefb4b-44c9-4947-9019-bc368a870fb2 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:14.654272 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-39cefb4b-44c9-4947-9019-bc368a870fb2 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:14.661159 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-39cefb4b-44c9-4947-9019-bc368a870fb2 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:14.661731 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-39cefb4b-44c9-4947-9019-bc368a870fb2 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:14.662165 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-39cefb4b-44c9-4947-9019-bc368a870fb2 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:14.662900 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-39cefb4b-44c9-4947-9019-bc368a870fb2 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:14.663353 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-39cefb4b-44c9-4947-9019-bc368a870fb2 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:14.663774 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-39cefb4b-44c9-4947-9019-bc368a870fb2 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:14.853578 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-39cefb4b-44c9-4947-9019-bc368a870fb2 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:14.864081 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-39cefb4b-44c9-4947-9019-bc368a870fb2 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:14.865854 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-39cefb4b-44c9-4947-9019-bc368a870fb2 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:14.867016 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-39cefb4b-44c9-4947-9019-bc368a870fb2 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1408 microversion: 2.20 time: 0.219047 Oct 24 08:53:14.867794 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 326/651] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:14 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1408 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:15.016551 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-23ca37f3-dc88-49af-8d18-660d89273e6f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:15.019706 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-23ca37f3-dc88-49af-8d18-660d89273e6f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:15.030246 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-23ca37f3-dc88-49af-8d18-660d89273e6f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:15.030850 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-23ca37f3-dc88-49af-8d18-660d89273e6f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:15.031299 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-23ca37f3-dc88-49af-8d18-660d89273e6f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:15.031917 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-23ca37f3-dc88-49af-8d18-660d89273e6f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:15.032371 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-23ca37f3-dc88-49af-8d18-660d89273e6f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:15.033452 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-23ca37f3-dc88-49af-8d18-660d89273e6f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:15.065812 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-23ca37f3-dc88-49af-8d18-660d89273e6f tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056330 Oct 24 08:53:15.071514 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 326/652] 10.222.0.26 () {58 vars in 1302 bytes} [Mon Oct 24 08:53:15 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:53:15.077627 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-1456fb93-8960-474b-bd0b-a1e7a032e1b3 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:15.078119 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-1456fb93-8960-474b-bd0b-a1e7a032e1b3 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:15.084085 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1456fb93-8960-474b-bd0b-a1e7a032e1b3 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:15.084570 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1456fb93-8960-474b-bd0b-a1e7a032e1b3 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:15.085003 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1456fb93-8960-474b-bd0b-a1e7a032e1b3 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:15.085694 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1456fb93-8960-474b-bd0b-a1e7a032e1b3 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:15.086143 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1456fb93-8960-474b-bd0b-a1e7a032e1b3 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:15.086559 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1456fb93-8960-474b-bd0b-a1e7a032e1b3 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:15.164616 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.wsgi [None req-1456fb93-8960-474b-bd0b-a1e7a032e1b3 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] HTTP exception thrown: Instance 89a67761-1e03-4ede-8f59-f719d6ea20d1 is not attached to volume a9463451-a0d9-48de-9a2e-d79819875aa5 Oct 24 08:53:15.171067 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-1456fb93-8960-474b-bd0b-a1e7a032e1b3 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Request method failure captured: Oct 24 08:53:15.171067 dv-cinder-master-3-smb devstack@n-api.service[125164]: request: DELETE /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1/os-volume_attachments/a9463451-a0d9-48de-9a2e-d79819875aa5 HTTP/1.1 Oct 24 08:53:15.171067 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept: application/json Oct 24 08:53:15.171067 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept-Encoding: identity Oct 24 08:53:15.171067 dv-cinder-master-3-smb devstack@n-api.service[125164]: Connection: close Oct 24 08:53:15.171067 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Length: 0 Oct 24 08:53:15.171067 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Type: application/json Oct 24 08:53:15.171067 dv-cinder-master-3-smb devstack@n-api.service[125164]: Host: 10.222.0.26 Oct 24 08:53:15.171067 dv-cinder-master-3-smb devstack@n-api.service[125164]: Openstack-System-Scope: None Oct 24 08:53:15.171067 dv-cinder-master-3-smb devstack@n-api.service[125164]: User-Agent: python-urllib3/1.26.12 Oct 24 08:53:15.171067 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Auth-Token: gAAAAABjVlF0f1I3Ejjy6webFEpS-5FAvTNcQ1j_8zgT-KzIcZWE0FUqdMUrjtQzTCfesBCnZG3WdIjTuNwgg7opxH0l-h7rn5KSqj0IsYh98sgorYulOpe8s_H8dwDzxqV-ktgyjKgz7OdvbiiBbGqsE2jzwBLgr_B97MzPZJxZwLJ8qBkP8Ec Oct 24 08:53:15.171067 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Id: None Oct 24 08:53:15.171067 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Name: None Oct 24 08:53:15.171067 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Identity-Status: Confirmed Oct 24 08:53:15.171067 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Is-Admin-Project: True Oct 24 08:53:15.171067 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Id: default Oct 24 08:53:15.171067 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Name: Default Oct 24 08:53:15.171067 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Id: 238b1450574c411682599a39ad0a8371 Oct 24 08:53:15.171067 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Name: tempest-TestMinimumBasicScenario-223048881 Oct 24 08:53:15.171067 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Role: reader,member Oct 24 08:53:15.171067 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Roles: reader,member Oct 24 08:53:15.172645 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_238b1450574c411682599a39ad0a8371", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/238b1450574c411682599a39ad0a8371"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/238b1450574c411682599a39ad0a8371"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/238b1450574c411682599a39ad0a8371"}]}] Oct 24 08:53:15.172645 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant: tempest-TestMinimumBasicScenario-223048881 Oct 24 08:53:15.172645 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Id: 238b1450574c411682599a39ad0a8371 Oct 24 08:53:15.172645 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Name: tempest-TestMinimumBasicScenario-223048881 Oct 24 08:53:15.172645 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User: tempest-TestMinimumBasicScenario-223048881-project Oct 24 08:53:15.172645 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Id: default Oct 24 08:53:15.172645 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Name: Default Oct 24 08:53:15.172645 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Id: 1aa023d6ce6b45efa086c40c292f4ad0 Oct 24 08:53:15.172645 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Name: tempest-TestMinimumBasicScenario-223048881-project Oct 24 08:53:15.172645 dv-cinder-master-3-smb devstack@n-api.service[125164]: method: > Oct 24 08:53:15.172645 dv-cinder-master-3-smb devstack@n-api.service[125164]: exception: Instance 89a67761-1e03-4ede-8f59-f719d6ea20d1 is not attached to volume a9463451-a0d9-48de-9a2e-d79819875aa5 Oct 24 08:53:15.173662 dv-cinder-master-3-smb devstack@n-api.service[125164]: action_args: {'server_id': '89a67761-1e03-4ede-8f59-f719d6ea20d1', 'id': 'a9463451-a0d9-48de-9a2e-d79819875aa5'} Oct 24 08:53:15.173662 dv-cinder-master-3-smb devstack@n-api.service[125164]: {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:53:15.173662 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:15.173662 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 24 08:53:15.173662 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 24 08:53:15.173662 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 08:53:15.173662 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 08:53:15.173662 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 24 08:53:15.173662 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 24 08:53:15.173662 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a9463451-a0d9-48de-9a2e-d79819875aa5. Oct 24 08:53:15.173662 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:53:15.173662 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:53:15.173662 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:53:15.173662 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:15.173662 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:53:15.173662 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:53:15.173662 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:53:15.173662 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:53:15.173662 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:53:15.175123 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:53:15.175123 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 24 08:53:15.175123 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 24 08:53:15.175123 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89a67761-1e03-4ede-8f59-f719d6ea20d1 is not attached to volume a9463451-a0d9-48de-9a2e-d79819875aa5 Oct 24 08:53:15.175123 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:53:15.175123 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:53:15.175123 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:53:15.175123 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:15.175123 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:53:15.175123 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:53:15.175123 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:53:15.175123 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:53:15.175123 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89a67761-1e03-4ede-8f59-f719d6ea20d1 is not attached to volume a9463451-a0d9-48de-9a2e-d79819875aa5 Oct 24 08:53:15.175123 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:53:15.175123 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-1456fb93-8960-474b-bd0b-a1e7a032e1b3 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Returning 404 to user: Instance 89a67761-1e03-4ede-8f59-f719d6ea20d1 is not attached to volume a9463451-a0d9-48de-9a2e-d79819875aa5 {{(pid=125164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:53:15.176192 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-1456fb93-8960-474b-bd0b-a1e7a032e1b3 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "DELETE /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1/os-volume_attachments/a9463451-a0d9-48de-9a2e-d79819875aa5" status: 404 len: 154 microversion: 2.1 time: 0.099149 Oct 24 08:53:15.176879 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 327/653] 10.222.0.26 () {58 vars in 1416 bytes} [Mon Oct 24 08:53:15 2022] DELETE /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1/os-volume_attachments/a9463451-a0d9-48de-9a2e-d79819875aa5 => generated 154 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:53:15.896255 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-c66428c7-c4ec-4a2b-b936-2ca326376f4e tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:15.897257 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-c66428c7-c4ec-4a2b-b936-2ca326376f4e tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:15.907375 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c66428c7-c4ec-4a2b-b936-2ca326376f4e tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:15.908184 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c66428c7-c4ec-4a2b-b936-2ca326376f4e tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:15.908912 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c66428c7-c4ec-4a2b-b936-2ca326376f4e tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:15.910048 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c66428c7-c4ec-4a2b-b936-2ca326376f4e tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:15.910799 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c66428c7-c4ec-4a2b-b936-2ca326376f4e tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:15.911554 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c66428c7-c4ec-4a2b-b936-2ca326376f4e tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:16.053351 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-c66428c7-c4ec-4a2b-b936-2ca326376f4e tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:16.062049 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-c66428c7-c4ec-4a2b-b936-2ca326376f4e tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:16.063529 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-c66428c7-c4ec-4a2b-b936-2ca326376f4e tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:16.064687 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-c66428c7-c4ec-4a2b-b936-2ca326376f4e tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1408 microversion: 2.20 time: 0.175236 Oct 24 08:53:16.065244 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 327/654] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:15 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:16.325491 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-c38861d8-323a-4678-81e4-aa1fb47bd9ec tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:16.325973 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-c38861d8-323a-4678-81e4-aa1fb47bd9ec tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:16.332619 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c38861d8-323a-4678-81e4-aa1fb47bd9ec tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:16.333100 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c38861d8-323a-4678-81e4-aa1fb47bd9ec tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:16.333532 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c38861d8-323a-4678-81e4-aa1fb47bd9ec tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:16.334220 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c38861d8-323a-4678-81e4-aa1fb47bd9ec tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:16.334667 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c38861d8-323a-4678-81e4-aa1fb47bd9ec tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:16.335127 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c38861d8-323a-4678-81e4-aa1fb47bd9ec tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:16.359818 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-c38861d8-323a-4678-81e4-aa1fb47bd9ec tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Going to try to terminate instance {{(pid=125164) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:53:16.382671 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:16.437877 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-c38861d8-323a-4678-81e4-aa1fb47bd9ec tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "DELETE /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 204 len: 0 microversion: 2.1 time: 0.116054 Oct 24 08:53:16.438443 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 328/655] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Oct 24 08:53:16 2022] DELETE /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:53:16.446624 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-1bf17c1e-bcda-4c22-9638-80b5cf132b5b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:16.447344 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-1bf17c1e-bcda-4c22-9638-80b5cf132b5b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:16.453213 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1bf17c1e-bcda-4c22-9638-80b5cf132b5b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:16.453694 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1bf17c1e-bcda-4c22-9638-80b5cf132b5b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:16.454125 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1bf17c1e-bcda-4c22-9638-80b5cf132b5b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:16.454895 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1bf17c1e-bcda-4c22-9638-80b5cf132b5b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:16.455351 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1bf17c1e-bcda-4c22-9638-80b5cf132b5b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:16.455802 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1bf17c1e-bcda-4c22-9638-80b5cf132b5b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:16.590311 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-1bf17c1e-bcda-4c22-9638-80b5cf132b5b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:16.602558 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-1bf17c1e-bcda-4c22-9638-80b5cf132b5b tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1553 microversion: 2.1 time: 0.159418 Oct 24 08:53:16.603349 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 328/656] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:16 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:17.094485 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-26cee4c4-690d-4017-999b-0a8c818c79d3 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:17.095802 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-26cee4c4-690d-4017-999b-0a8c818c79d3 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:17.102781 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-26cee4c4-690d-4017-999b-0a8c818c79d3 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:17.103309 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-26cee4c4-690d-4017-999b-0a8c818c79d3 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:17.103794 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-26cee4c4-690d-4017-999b-0a8c818c79d3 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:17.104541 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-26cee4c4-690d-4017-999b-0a8c818c79d3 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:17.105037 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-26cee4c4-690d-4017-999b-0a8c818c79d3 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:17.105506 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-26cee4c4-690d-4017-999b-0a8c818c79d3 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:17.243805 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-26cee4c4-690d-4017-999b-0a8c818c79d3 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:17.256313 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-26cee4c4-690d-4017-999b-0a8c818c79d3 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:17.258556 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-26cee4c4-690d-4017-999b-0a8c818c79d3 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:17.260310 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-26cee4c4-690d-4017-999b-0a8c818c79d3 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1408 microversion: 2.20 time: 0.173022 Oct 24 08:53:17.261129 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 329/657] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:17 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:17.631331 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-919ff4aa-16a0-40b8-afa0-c4b6a9df3d92 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:17.632302 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-919ff4aa-16a0-40b8-afa0-c4b6a9df3d92 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:17.641052 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-919ff4aa-16a0-40b8-afa0-c4b6a9df3d92 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:17.641731 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-919ff4aa-16a0-40b8-afa0-c4b6a9df3d92 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:17.642341 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-919ff4aa-16a0-40b8-afa0-c4b6a9df3d92 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:17.643348 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-919ff4aa-16a0-40b8-afa0-c4b6a9df3d92 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:17.643983 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-919ff4aa-16a0-40b8-afa0-c4b6a9df3d92 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:17.644576 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-919ff4aa-16a0-40b8-afa0-c4b6a9df3d92 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:17.779145 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-919ff4aa-16a0-40b8-afa0-c4b6a9df3d92 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:17.786958 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-919ff4aa-16a0-40b8-afa0-c4b6a9df3d92 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1553 microversion: 2.1 time: 0.161293 Oct 24 08:53:17.787540 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 329/658] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:17 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:18.287822 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-704ac661-d259-4812-bfa1-03b9475137fe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:18.288504 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-704ac661-d259-4812-bfa1-03b9475137fe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:18.295865 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-704ac661-d259-4812-bfa1-03b9475137fe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:18.296349 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-704ac661-d259-4812-bfa1-03b9475137fe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:18.296785 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-704ac661-d259-4812-bfa1-03b9475137fe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:18.297474 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-704ac661-d259-4812-bfa1-03b9475137fe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:18.297928 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-704ac661-d259-4812-bfa1-03b9475137fe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:18.298348 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-704ac661-d259-4812-bfa1-03b9475137fe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:18.436272 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-704ac661-d259-4812-bfa1-03b9475137fe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:18.444728 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-704ac661-d259-4812-bfa1-03b9475137fe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:18.446143 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-704ac661-d259-4812-bfa1-03b9475137fe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:18.447271 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-704ac661-d259-4812-bfa1-03b9475137fe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1408 microversion: 2.20 time: 0.163489 Oct 24 08:53:18.447824 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 330/659] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:18 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:18.814244 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-80ee8a8e-bdbf-40d9-b23b-fe502b482578 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:18.815289 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-80ee8a8e-bdbf-40d9-b23b-fe502b482578 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:18.825963 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-80ee8a8e-bdbf-40d9-b23b-fe502b482578 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:18.826793 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-80ee8a8e-bdbf-40d9-b23b-fe502b482578 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:18.827651 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-80ee8a8e-bdbf-40d9-b23b-fe502b482578 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:18.828948 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-80ee8a8e-bdbf-40d9-b23b-fe502b482578 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:18.829891 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-80ee8a8e-bdbf-40d9-b23b-fe502b482578 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:18.830352 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-80ee8a8e-bdbf-40d9-b23b-fe502b482578 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:18.963830 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-80ee8a8e-bdbf-40d9-b23b-fe502b482578 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:18.971469 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-80ee8a8e-bdbf-40d9-b23b-fe502b482578 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1553 microversion: 2.1 time: 0.163745 Oct 24 08:53:18.972028 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 330/660] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:18 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:19.475896 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-5599d28e-8dbd-415b-8a6a-acfe88468303 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:19.476892 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-5599d28e-8dbd-415b-8a6a-acfe88468303 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:19.487216 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5599d28e-8dbd-415b-8a6a-acfe88468303 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:19.487695 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5599d28e-8dbd-415b-8a6a-acfe88468303 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:19.488121 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5599d28e-8dbd-415b-8a6a-acfe88468303 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:19.488803 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5599d28e-8dbd-415b-8a6a-acfe88468303 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:19.489255 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5599d28e-8dbd-415b-8a6a-acfe88468303 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:19.489669 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5599d28e-8dbd-415b-8a6a-acfe88468303 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:19.618051 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-5599d28e-8dbd-415b-8a6a-acfe88468303 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:19.626184 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-5599d28e-8dbd-415b-8a6a-acfe88468303 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:19.627733 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-5599d28e-8dbd-415b-8a6a-acfe88468303 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:19.628830 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-5599d28e-8dbd-415b-8a6a-acfe88468303 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1408 microversion: 2.20 time: 0.159536 Oct 24 08:53:19.629385 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 331/661] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:19 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:19.998776 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-073b99d2-a694-4c0b-9042-77dff4347d0a tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:19.999774 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-073b99d2-a694-4c0b-9042-77dff4347d0a tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:20.002555 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:20.008385 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-073b99d2-a694-4c0b-9042-77dff4347d0a tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:20.008879 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-073b99d2-a694-4c0b-9042-77dff4347d0a tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:20.009408 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-073b99d2-a694-4c0b-9042-77dff4347d0a tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:20.010089 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-073b99d2-a694-4c0b-9042-77dff4347d0a tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:20.010532 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-073b99d2-a694-4c0b-9042-77dff4347d0a tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:20.010973 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-073b99d2-a694-4c0b-9042-77dff4347d0a tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:20.142853 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-073b99d2-a694-4c0b-9042-77dff4347d0a tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:20.150620 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-073b99d2-a694-4c0b-9042-77dff4347d0a tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1553 microversion: 2.1 time: 0.158445 Oct 24 08:53:20.151216 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 331/662] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:19 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:20.654085 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-46ddd4be-69b2-40c0-8985-4cad91826518 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:20.654944 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-46ddd4be-69b2-40c0-8985-4cad91826518 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:20.662092 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-46ddd4be-69b2-40c0-8985-4cad91826518 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:20.662581 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-46ddd4be-69b2-40c0-8985-4cad91826518 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:20.663076 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-46ddd4be-69b2-40c0-8985-4cad91826518 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:20.663838 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-46ddd4be-69b2-40c0-8985-4cad91826518 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:20.664315 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-46ddd4be-69b2-40c0-8985-4cad91826518 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:20.664772 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-46ddd4be-69b2-40c0-8985-4cad91826518 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:20.861284 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-46ddd4be-69b2-40c0-8985-4cad91826518 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:20.869753 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-46ddd4be-69b2-40c0-8985-4cad91826518 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:20.871437 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-46ddd4be-69b2-40c0-8985-4cad91826518 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:20.872627 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-46ddd4be-69b2-40c0-8985-4cad91826518 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1408 microversion: 2.20 time: 0.223034 Oct 24 08:53:20.873241 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 332/663] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:20 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1408 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:21.034618 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-85ffddb4-e274-48ae-8678-2adcd1d7321a req-7f190079-2fa7-4694-8d20-4292d7cefbfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89a67761-1e03-4ede-8f59-f719d6ea20d1", "name": "network-vif-deleted", "tag": "5693bb11-79fc-4a3c-bc79-8cc96cab3b00"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:21.044105 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-85ffddb4-e274-48ae-8678-2adcd1d7321a req-7f190079-2fa7-4694-8d20-4292d7cefbfd service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:21.044890 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-85ffddb4-e274-48ae-8678-2adcd1d7321a req-7f190079-2fa7-4694-8d20-4292d7cefbfd service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:21.045317 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-85ffddb4-e274-48ae-8678-2adcd1d7321a req-7f190079-2fa7-4694-8d20-4292d7cefbfd service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:21.056525 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-85ffddb4-e274-48ae-8678-2adcd1d7321a req-7f190079-2fa7-4694-8d20-4292d7cefbfd service nova] Creating event network-vif-deleted:5693bb11-79fc-4a3c-bc79-8cc96cab3b00 for instance 89a67761-1e03-4ede-8f59-f719d6ea20d1 on hv-cinder-maste Oct 24 08:53:21.061604 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-85ffddb4-e274-48ae-8678-2adcd1d7321a req-7f190079-2fa7-4694-8d20-4292d7cefbfd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087497 Oct 24 08:53:21.062283 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 332/664] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:21.173902 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-1c39565b-c92a-4bb5-b71a-3557255337c1 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:21.174535 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-1c39565b-c92a-4bb5-b71a-3557255337c1 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:21.180824 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1c39565b-c92a-4bb5-b71a-3557255337c1 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:21.181382 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1c39565b-c92a-4bb5-b71a-3557255337c1 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:21.181912 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1c39565b-c92a-4bb5-b71a-3557255337c1 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:21.182660 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1c39565b-c92a-4bb5-b71a-3557255337c1 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:21.183275 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1c39565b-c92a-4bb5-b71a-3557255337c1 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:21.183702 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1c39565b-c92a-4bb5-b71a-3557255337c1 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:21.346495 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell0:SELECT=6 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:21.374469 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1c39565b-c92a-4bb5-b71a-3557255337c1 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:21.374980 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1c39565b-c92a-4bb5-b71a-3557255337c1 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:21.375412 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1c39565b-c92a-4bb5-b71a-3557255337c1 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:21.375856 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.objects.instance [None req-1c39565b-c92a-4bb5-b71a-3557255337c1 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lazy-loading 'fault' on Instance uuid 89a67761-1e03-4ede-8f59-f719d6ea20d1 {{(pid=125164) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:53:21.418939 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-1c39565b-c92a-4bb5-b71a-3557255337c1 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa023d6ce6b45efa086c40c292f4ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238b1450574c411682599a39ad0a8371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:21.428125 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-1c39565b-c92a-4bb5-b71a-3557255337c1 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 200 len: 1348 microversion: 2.1 time: 0.258415 Oct 24 08:53:21.428879 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 333/665] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:21 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 1348 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:21.750210 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell0:SELECT=2 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:21.751271 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell0:SELECT=6 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:21.756200 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-6ebe7d7b-26d4-44f3-bc85-38191d0724a0 req-d6bdbb1d-619e-4c6c-869f-a836552e846b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa2753cf-624f-4bf1-b85b-0fef0e35521c", "name": "network-vif-plugged", "status": "completed", "tag": "8db8d394-e903-4fe4-92d4-9750c49eb4c4"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:21.768041 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-6ebe7d7b-26d4-44f3-bc85-38191d0724a0 req-d6bdbb1d-619e-4c6c-869f-a836552e846b service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:21.768768 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-6ebe7d7b-26d4-44f3-bc85-38191d0724a0 req-d6bdbb1d-619e-4c6c-869f-a836552e846b service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:21.769272 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-6ebe7d7b-26d4-44f3-bc85-38191d0724a0 req-d6bdbb1d-619e-4c6c-869f-a836552e846b service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:21.780402 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-6ebe7d7b-26d4-44f3-bc85-38191d0724a0 req-d6bdbb1d-619e-4c6c-869f-a836552e846b service nova] Creating event network-vif-plugged:8db8d394-e903-4fe4-92d4-9750c49eb4c4 for instance aa2753cf-624f-4bf1-b85b-0fef0e35521c on hv-cinder-maste Oct 24 08:53:21.785505 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-6ebe7d7b-26d4-44f3-bc85-38191d0724a0 req-d6bdbb1d-619e-4c6c-869f-a836552e846b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036381 Oct 24 08:53:21.786548 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 333/666] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:21.900206 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-2262caf6-d614-459e-9363-6f030f4b3938 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:21.900823 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-2262caf6-d614-459e-9363-6f030f4b3938 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:21.903097 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:21.909136 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2262caf6-d614-459e-9363-6f030f4b3938 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:21.909750 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2262caf6-d614-459e-9363-6f030f4b3938 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:21.910182 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2262caf6-d614-459e-9363-6f030f4b3938 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:21.910895 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2262caf6-d614-459e-9363-6f030f4b3938 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:21.911347 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2262caf6-d614-459e-9363-6f030f4b3938 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:21.911762 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2262caf6-d614-459e-9363-6f030f4b3938 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:22.101255 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-2262caf6-d614-459e-9363-6f030f4b3938 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:22.112914 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-2262caf6-d614-459e-9363-6f030f4b3938 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:22.115145 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-2262caf6-d614-459e-9363-6f030f4b3938 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:22.116808 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-2262caf6-d614-459e-9363-6f030f4b3938 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1408 microversion: 2.20 time: 0.220611 Oct 24 08:53:22.117530 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 334/667] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:21 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1408 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:22.456147 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-ffd4dce2-6d6b-40e4-b41f-995e48b74c49 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:22.456909 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-ffd4dce2-6d6b-40e4-b41f-995e48b74c49 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] [instance: 89a67761-1e03-4ede-8f59-f719d6ea20d1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:22.463856 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ffd4dce2-6d6b-40e4-b41f-995e48b74c49 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:22.464364 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ffd4dce2-6d6b-40e4-b41f-995e48b74c49 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:22.464821 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ffd4dce2-6d6b-40e4-b41f-995e48b74c49 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:22.465535 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ffd4dce2-6d6b-40e4-b41f-995e48b74c49 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:22.466006 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ffd4dce2-6d6b-40e4-b41f-995e48b74c49 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:22.466448 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ffd4dce2-6d6b-40e4-b41f-995e48b74c49 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:22.480369 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.wsgi [None req-ffd4dce2-6d6b-40e4-b41f-995e48b74c49 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] HTTP exception thrown: Instance 89a67761-1e03-4ede-8f59-f719d6ea20d1 could not be found. Oct 24 08:53:22.482083 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-ffd4dce2-6d6b-40e4-b41f-995e48b74c49 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Request method failure captured: Oct 24 08:53:22.482083 dv-cinder-master-3-smb devstack@n-api.service[125165]: request: GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 HTTP/1.1 Oct 24 08:53:22.482083 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept: application/json Oct 24 08:53:22.482083 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept-Encoding: identity Oct 24 08:53:22.482083 dv-cinder-master-3-smb devstack@n-api.service[125165]: Connection: close Oct 24 08:53:22.482083 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Length: 0 Oct 24 08:53:22.482083 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Type: application/json Oct 24 08:53:22.482083 dv-cinder-master-3-smb devstack@n-api.service[125165]: Host: 10.222.0.26 Oct 24 08:53:22.482083 dv-cinder-master-3-smb devstack@n-api.service[125165]: Openstack-System-Scope: None Oct 24 08:53:22.482083 dv-cinder-master-3-smb devstack@n-api.service[125165]: User-Agent: python-urllib3/1.26.12 Oct 24 08:53:22.482083 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Auth-Token: gAAAAABjVlF0f1I3Ejjy6webFEpS-5FAvTNcQ1j_8zgT-KzIcZWE0FUqdMUrjtQzTCfesBCnZG3WdIjTuNwgg7opxH0l-h7rn5KSqj0IsYh98sgorYulOpe8s_H8dwDzxqV-ktgyjKgz7OdvbiiBbGqsE2jzwBLgr_B97MzPZJxZwLJ8qBkP8Ec Oct 24 08:53:22.482083 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Id: None Oct 24 08:53:22.482083 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Name: None Oct 24 08:53:22.482083 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Identity-Status: Confirmed Oct 24 08:53:22.482083 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Is-Admin-Project: True Oct 24 08:53:22.482083 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Id: default Oct 24 08:53:22.482083 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Name: Default Oct 24 08:53:22.482083 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Id: 238b1450574c411682599a39ad0a8371 Oct 24 08:53:22.482083 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Name: tempest-TestMinimumBasicScenario-223048881 Oct 24 08:53:22.482083 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Role: reader,member Oct 24 08:53:22.482083 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Roles: reader,member Oct 24 08:53:22.483747 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_238b1450574c411682599a39ad0a8371", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/238b1450574c411682599a39ad0a8371"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/238b1450574c411682599a39ad0a8371"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/238b1450574c411682599a39ad0a8371"}]}] Oct 24 08:53:22.483747 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant: tempest-TestMinimumBasicScenario-223048881 Oct 24 08:53:22.483747 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Id: 238b1450574c411682599a39ad0a8371 Oct 24 08:53:22.483747 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Name: tempest-TestMinimumBasicScenario-223048881 Oct 24 08:53:22.483747 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User: tempest-TestMinimumBasicScenario-223048881-project Oct 24 08:53:22.483747 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Id: default Oct 24 08:53:22.483747 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Name: Default Oct 24 08:53:22.483747 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Id: 1aa023d6ce6b45efa086c40c292f4ad0 Oct 24 08:53:22.483747 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Name: tempest-TestMinimumBasicScenario-223048881-project Oct 24 08:53:22.483747 dv-cinder-master-3-smb devstack@n-api.service[125165]: method: > Oct 24 08:53:22.483747 dv-cinder-master-3-smb devstack@n-api.service[125165]: exception: Instance 89a67761-1e03-4ede-8f59-f719d6ea20d1 could not be found. Oct 24 08:53:22.483747 dv-cinder-master-3-smb devstack@n-api.service[125165]: action_args: {'id': '89a67761-1e03-4ede-8f59-f719d6ea20d1'} Oct 24 08:53:22.484581 dv-cinder-master-3-smb devstack@n-api.service[125165]: {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:53:22.484581 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:22.484581 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:53:22.484581 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:53:22.484581 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:53:22.484581 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:53:22.484581 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:53:22.484581 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:53:22.484581 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:53:22.484581 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:53:22.484581 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89a67761-1e03-4ede-8f59-f719d6ea20d1 could not be found. Oct 24 08:53:22.484581 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:53:22.484581 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:53:22.484581 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:53:22.484581 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:22.484581 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:53:22.484581 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:53:22.484581 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:53:22.484581 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:53:22.484581 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:53:22.485781 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:53:22.485781 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:53:22.485781 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:53:22.485781 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:53:22.485781 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:53:22.485781 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:53:22.485781 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:53:22.485781 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89a67761-1e03-4ede-8f59-f719d6ea20d1 could not be found. Oct 24 08:53:22.485781 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:53:22.485781 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:53:22.485781 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:53:22.485781 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:22.485781 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:53:22.485781 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:53:22.485781 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:53:22.485781 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:53:22.485781 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89a67761-1e03-4ede-8f59-f719d6ea20d1 could not be found. Oct 24 08:53:22.485781 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:53:22.487130 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-ffd4dce2-6d6b-40e4-b41f-995e48b74c49 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Returning 404 to user: Instance 89a67761-1e03-4ede-8f59-f719d6ea20d1 could not be found. {{(pid=125165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:53:22.487130 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-ffd4dce2-6d6b-40e4-b41f-995e48b74c49 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1" status: 404 len: 111 microversion: 2.1 time: 0.034130 Oct 24 08:53:22.487130 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 334/668] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:22 2022] GET /compute/v2.1/servers/89a67761-1e03-4ede-8f59-f719d6ea20d1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:53:22.494487 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-c2c94ec0-9e59-4602-bcbf-d646e0e8eb99 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] Calling method '.version_select at 0x7f7ef13298b0>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:22.516093 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-c2c94ec0-9e59-4602-bcbf-d646e0e8eb99 tempest-TestMinimumBasicScenario-223048881 tempest-TestMinimumBasicScenario-223048881-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1898398287" status: 202 len: 0 microversion: 2.1 time: 0.025863 Oct 24 08:53:22.516638 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 335/669] 10.222.0.26 () {58 vars in 1272 bytes} [Mon Oct 24 08:53:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1898398287 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:53:23.143451 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-3b8e37db-8ab9-44b4-a5cc-d146fa7f8ab5 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:23.144086 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-3b8e37db-8ab9-44b4-a5cc-d146fa7f8ab5 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:23.150146 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3b8e37db-8ab9-44b4-a5cc-d146fa7f8ab5 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:23.150633 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3b8e37db-8ab9-44b4-a5cc-d146fa7f8ab5 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:23.151101 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3b8e37db-8ab9-44b4-a5cc-d146fa7f8ab5 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:23.151786 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3b8e37db-8ab9-44b4-a5cc-d146fa7f8ab5 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:23.152232 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3b8e37db-8ab9-44b4-a5cc-d146fa7f8ab5 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:23.152648 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3b8e37db-8ab9-44b4-a5cc-d146fa7f8ab5 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:23.283594 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-3b8e37db-8ab9-44b4-a5cc-d146fa7f8ab5 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:23.291985 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-3b8e37db-8ab9-44b4-a5cc-d146fa7f8ab5 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:23.293401 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-3b8e37db-8ab9-44b4-a5cc-d146fa7f8ab5 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:23.294510 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-3b8e37db-8ab9-44b4-a5cc-d146fa7f8ab5 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1408 microversion: 2.20 time: 0.155071 Oct 24 08:53:23.295414 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 335/670] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:23 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:24.325655 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-786ef478-744e-4135-8d15-e60f3073bb8f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:24.330054 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-786ef478-744e-4135-8d15-e60f3073bb8f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:24.340686 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-786ef478-744e-4135-8d15-e60f3073bb8f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:24.341349 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-786ef478-744e-4135-8d15-e60f3073bb8f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:24.345163 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-786ef478-744e-4135-8d15-e60f3073bb8f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:24.345958 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-786ef478-744e-4135-8d15-e60f3073bb8f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:24.347153 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-786ef478-744e-4135-8d15-e60f3073bb8f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:24.347580 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-786ef478-744e-4135-8d15-e60f3073bb8f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:24.484260 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-786ef478-744e-4135-8d15-e60f3073bb8f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:24.493102 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-786ef478-744e-4135-8d15-e60f3073bb8f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:24.494532 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-786ef478-744e-4135-8d15-e60f3073bb8f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:24.495747 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-786ef478-744e-4135-8d15-e60f3073bb8f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1599 microversion: 2.20 time: 0.174871 Oct 24 08:53:24.496449 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 336/671] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:53:24 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1599 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:53:24.521784 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-7178a63b-6820-4a2a-8e2c-c3ad5d7edfb0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:24.522989 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-7178a63b-6820-4a2a-8e2c-c3ad5d7edfb0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:24.529124 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7178a63b-6820-4a2a-8e2c-c3ad5d7edfb0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:24.529787 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7178a63b-6820-4a2a-8e2c-c3ad5d7edfb0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:24.530221 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7178a63b-6820-4a2a-8e2c-c3ad5d7edfb0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:24.531125 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7178a63b-6820-4a2a-8e2c-c3ad5d7edfb0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:24.531580 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7178a63b-6820-4a2a-8e2c-c3ad5d7edfb0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:24.531999 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7178a63b-6820-4a2a-8e2c-c3ad5d7edfb0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:24.611707 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-7178a63b-6820-4a2a-8e2c-c3ad5d7edfb0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.095352 Oct 24 08:53:24.612330 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 336/672] 10.222.0.26 () {60 vars in 1316 bytes} [Mon Oct 24 08:53:24 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:53:25.686869 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-c9d81cdf-4023-4804-8635-efe31abe38e0 req-536efa51-dd7b-4d78-b71e-f9aeb9be324c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa2753cf-624f-4bf1-b85b-0fef0e35521c", "tag": "8db8d394-e903-4fe4-92d4-9750c49eb4c4"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:25.703936 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-c9d81cdf-4023-4804-8635-efe31abe38e0 req-536efa51-dd7b-4d78-b71e-f9aeb9be324c service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:25.704940 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-c9d81cdf-4023-4804-8635-efe31abe38e0 req-536efa51-dd7b-4d78-b71e-f9aeb9be324c service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:25.705736 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-c9d81cdf-4023-4804-8635-efe31abe38e0 req-536efa51-dd7b-4d78-b71e-f9aeb9be324c service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:25.719256 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-c9d81cdf-4023-4804-8635-efe31abe38e0 req-536efa51-dd7b-4d78-b71e-f9aeb9be324c service nova] Creating event network-changed:8db8d394-e903-4fe4-92d4-9750c49eb4c4 for instance aa2753cf-624f-4bf1-b85b-0fef0e35521c on hv-cinder-maste Oct 24 08:53:25.724967 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-c9d81cdf-4023-4804-8635-efe31abe38e0 req-536efa51-dd7b-4d78-b71e-f9aeb9be324c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044761 Oct 24 08:53:25.725882 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 337/673] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:28.375408 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-e4bdd01b-8087-487d-8fa5-1de4735b8194 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:28.377777 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-e4bdd01b-8087-487d-8fa5-1de4735b8194 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:28.386311 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e4bdd01b-8087-487d-8fa5-1de4735b8194 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:28.387086 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e4bdd01b-8087-487d-8fa5-1de4735b8194 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:28.387767 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e4bdd01b-8087-487d-8fa5-1de4735b8194 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:28.388696 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e4bdd01b-8087-487d-8fa5-1de4735b8194 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:28.389351 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e4bdd01b-8087-487d-8fa5-1de4735b8194 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:28.389974 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e4bdd01b-8087-487d-8fa5-1de4735b8194 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:28.423159 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-e4bdd01b-8087-487d-8fa5-1de4735b8194 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052434 Oct 24 08:53:28.429905 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 337/674] 10.222.0.26 () {58 vars in 1302 bytes} [Mon Oct 24 08:53:28 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:53:28.495738 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-719b251e-b6f1-423d-9aad-7fb5f89fc147 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:28.496302 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-719b251e-b6f1-423d-9aad-7fb5f89fc147 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:28.502673 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-719b251e-b6f1-423d-9aad-7fb5f89fc147 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:28.503208 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-719b251e-b6f1-423d-9aad-7fb5f89fc147 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:28.503641 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-719b251e-b6f1-423d-9aad-7fb5f89fc147 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:28.504301 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-719b251e-b6f1-423d-9aad-7fb5f89fc147 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:28.504965 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-719b251e-b6f1-423d-9aad-7fb5f89fc147 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:28.505405 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-719b251e-b6f1-423d-9aad-7fb5f89fc147 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:28.531908 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-719b251e-b6f1-423d-9aad-7fb5f89fc147 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Going to try to terminate instance {{(pid=125164) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:53:28.621932 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-719b251e-b6f1-423d-9aad-7fb5f89fc147 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "DELETE /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 204 len: 0 microversion: 2.1 time: 0.130129 Oct 24 08:53:28.622937 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 338/675] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Oct 24 08:53:28 2022] DELETE /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 08:53:28.634907 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-c0369970-fac2-41cf-a4aa-19e2a23c67df tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:28.635970 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-c0369970-fac2-41cf-a4aa-19e2a23c67df tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:28.642400 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c0369970-fac2-41cf-a4aa-19e2a23c67df tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:28.642838 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c0369970-fac2-41cf-a4aa-19e2a23c67df tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:28.643267 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c0369970-fac2-41cf-a4aa-19e2a23c67df tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:28.643965 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c0369970-fac2-41cf-a4aa-19e2a23c67df tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:28.644898 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c0369970-fac2-41cf-a4aa-19e2a23c67df tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:28.645522 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c0369970-fac2-41cf-a4aa-19e2a23c67df tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:28.777616 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-c0369970-fac2-41cf-a4aa-19e2a23c67df tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:28.787080 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-c0369970-fac2-41cf-a4aa-19e2a23c67df tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1675 microversion: 2.1 time: 0.159770 Oct 24 08:53:28.787702 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 338/676] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:28 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:53:29.811486 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-55e4c129-13e4-4cbf-86bd-601b933739aa tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:29.812248 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-55e4c129-13e4-4cbf-86bd-601b933739aa tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:29.818953 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-55e4c129-13e4-4cbf-86bd-601b933739aa tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:29.819621 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-55e4c129-13e4-4cbf-86bd-601b933739aa tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:29.820163 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-55e4c129-13e4-4cbf-86bd-601b933739aa tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:29.820917 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-55e4c129-13e4-4cbf-86bd-601b933739aa tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:29.821430 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-55e4c129-13e4-4cbf-86bd-601b933739aa tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:29.821914 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-55e4c129-13e4-4cbf-86bd-601b933739aa tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:30.013349 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-55e4c129-13e4-4cbf-86bd-601b933739aa tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:30.021689 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-55e4c129-13e4-4cbf-86bd-601b933739aa tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1675 microversion: 2.1 time: 0.214510 Oct 24 08:53:30.022350 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 339/677] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:29 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1675 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:31.045256 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-61ee3d13-e5a7-4a49-b72d-43dca3b4a3fb tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:31.045863 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-61ee3d13-e5a7-4a49-b72d-43dca3b4a3fb tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:31.051881 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-61ee3d13-e5a7-4a49-b72d-43dca3b4a3fb tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:31.052583 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-61ee3d13-e5a7-4a49-b72d-43dca3b4a3fb tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:31.053017 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-61ee3d13-e5a7-4a49-b72d-43dca3b4a3fb tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:31.053695 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-61ee3d13-e5a7-4a49-b72d-43dca3b4a3fb tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:31.054142 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-61ee3d13-e5a7-4a49-b72d-43dca3b4a3fb tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:31.054558 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-61ee3d13-e5a7-4a49-b72d-43dca3b4a3fb tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:31.263036 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-61ee3d13-e5a7-4a49-b72d-43dca3b4a3fb tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:31.272239 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-61ee3d13-e5a7-4a49-b72d-43dca3b4a3fb tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 200 len: 1675 microversion: 2.1 time: 0.231121 Oct 24 08:53:31.273626 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 339/678] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:31 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 1675 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:31.541611 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-f26f21a3-d736-4414-bbce-b0042f89496d req-1b104a90-9813-45d9-81fd-81889dc9ec5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "031a03be-3f3b-46dd-944c-6e68a9d8b09a", "name": "network-vif-deleted", "tag": "634028ec-acae-487c-82c9-606115b581ba"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:31.553526 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-f26f21a3-d736-4414-bbce-b0042f89496d req-1b104a90-9813-45d9-81fd-81889dc9ec5b service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:31.554111 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-f26f21a3-d736-4414-bbce-b0042f89496d req-1b104a90-9813-45d9-81fd-81889dc9ec5b service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:31.554534 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-f26f21a3-d736-4414-bbce-b0042f89496d req-1b104a90-9813-45d9-81fd-81889dc9ec5b service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:31.571148 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-f26f21a3-d736-4414-bbce-b0042f89496d req-1b104a90-9813-45d9-81fd-81889dc9ec5b service nova] Creating event network-vif-deleted:634028ec-acae-487c-82c9-606115b581ba for instance 031a03be-3f3b-46dd-944c-6e68a9d8b09a on hv-cinder-maste Oct 24 08:53:31.576877 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-f26f21a3-d736-4414-bbce-b0042f89496d req-1b104a90-9813-45d9-81fd-81889dc9ec5b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039745 Oct 24 08:53:31.577473 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 340/679] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:32.298292 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-643e1154-0408-4f2e-a2ab-d1f77cfd0b07 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:32.299195 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-643e1154-0408-4f2e-a2ab-d1f77cfd0b07 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:32.307241 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-643e1154-0408-4f2e-a2ab-d1f77cfd0b07 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:32.307873 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-643e1154-0408-4f2e-a2ab-d1f77cfd0b07 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:32.308305 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-643e1154-0408-4f2e-a2ab-d1f77cfd0b07 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:32.309075 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-643e1154-0408-4f2e-a2ab-d1f77cfd0b07 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:32.309426 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-643e1154-0408-4f2e-a2ab-d1f77cfd0b07 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:32.309842 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-643e1154-0408-4f2e-a2ab-d1f77cfd0b07 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:32.325416 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.wsgi [None req-643e1154-0408-4f2e-a2ab-d1f77cfd0b07 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] HTTP exception thrown: Instance 031a03be-3f3b-46dd-944c-6e68a9d8b09a could not be found. Oct 24 08:53:32.326993 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-643e1154-0408-4f2e-a2ab-d1f77cfd0b07 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Request method failure captured: Oct 24 08:53:32.326993 dv-cinder-master-3-smb devstack@n-api.service[125165]: request: GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a HTTP/1.1 Oct 24 08:53:32.326993 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept: application/json Oct 24 08:53:32.326993 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept-Encoding: identity Oct 24 08:53:32.326993 dv-cinder-master-3-smb devstack@n-api.service[125165]: Connection: close Oct 24 08:53:32.326993 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Length: 0 Oct 24 08:53:32.326993 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Type: application/json Oct 24 08:53:32.326993 dv-cinder-master-3-smb devstack@n-api.service[125165]: Host: 10.222.0.26 Oct 24 08:53:32.326993 dv-cinder-master-3-smb devstack@n-api.service[125165]: Openstack-System-Scope: None Oct 24 08:53:32.326993 dv-cinder-master-3-smb devstack@n-api.service[125165]: User-Agent: python-urllib3/1.26.12 Oct 24 08:53:32.326993 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Auth-Token: gAAAAABjVlEs7zvth7MHnGv5-srWFzIELY1EVJulvVew2aEj9f6LOenv6UXPx3kmL3jEMG7S0jyRtdGO2jKPLeRZ0c32ZGEq_aJAMtG02gWOFj_aMoKatwpYO1kkmmPd1CJABfG_8pAlpaUMho-e91opS3LwG_-hYLEPuoOd7BOJhPCD_r4uk_g Oct 24 08:53:32.326993 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Id: None Oct 24 08:53:32.326993 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Name: None Oct 24 08:53:32.326993 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Identity-Status: Confirmed Oct 24 08:53:32.326993 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Is-Admin-Project: True Oct 24 08:53:32.326993 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Id: default Oct 24 08:53:32.326993 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Name: Default Oct 24 08:53:32.326993 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Id: e3b77fd80fd84c29b4581fda1ff8cef9 Oct 24 08:53:32.326993 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Name: tempest-AttachVolumeTestJSON-292776923 Oct 24 08:53:32.326993 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Role: reader,member Oct 24 08:53:32.326993 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Roles: reader,member Oct 24 08:53:32.328555 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e3b77fd80fd84c29b4581fda1ff8cef9", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e3b77fd80fd84c29b4581fda1ff8cef9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e3b77fd80fd84c29b4581fda1ff8cef9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e3b77fd80fd84c29b4581fda1ff8cef9"}]}] Oct 24 08:53:32.328555 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant: tempest-AttachVolumeTestJSON-292776923 Oct 24 08:53:32.328555 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Id: e3b77fd80fd84c29b4581fda1ff8cef9 Oct 24 08:53:32.328555 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Name: tempest-AttachVolumeTestJSON-292776923 Oct 24 08:53:32.328555 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User: tempest-AttachVolumeTestJSON-292776923-project Oct 24 08:53:32.328555 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Id: default Oct 24 08:53:32.328555 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Name: Default Oct 24 08:53:32.328555 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Id: 7d793a1f26a3467ea8119e27e3394371 Oct 24 08:53:32.328555 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Name: tempest-AttachVolumeTestJSON-292776923-project Oct 24 08:53:32.328555 dv-cinder-master-3-smb devstack@n-api.service[125165]: method: > Oct 24 08:53:32.328555 dv-cinder-master-3-smb devstack@n-api.service[125165]: exception: Instance 031a03be-3f3b-46dd-944c-6e68a9d8b09a could not be found. Oct 24 08:53:32.328555 dv-cinder-master-3-smb devstack@n-api.service[125165]: action_args: {'id': '031a03be-3f3b-46dd-944c-6e68a9d8b09a'} Oct 24 08:53:32.330122 dv-cinder-master-3-smb devstack@n-api.service[125165]: {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:53:32.330122 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:32.330122 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:53:32.330122 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:53:32.330122 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:53:32.330122 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:53:32.330122 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:53:32.330122 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:53:32.330122 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:53:32.330122 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:53:32.330122 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 031a03be-3f3b-46dd-944c-6e68a9d8b09a could not be found. Oct 24 08:53:32.330122 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:53:32.330122 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:53:32.330122 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:53:32.330122 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:32.330122 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:53:32.330122 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:53:32.330122 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:53:32.330122 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:53:32.330122 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:53:32.331400 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:53:32.331400 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:53:32.331400 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:53:32.331400 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:53:32.331400 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:53:32.331400 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:53:32.331400 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:53:32.331400 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 031a03be-3f3b-46dd-944c-6e68a9d8b09a could not be found. Oct 24 08:53:32.331400 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:53:32.331400 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:53:32.331400 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:53:32.331400 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:53:32.331400 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:53:32.331400 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:53:32.331400 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:53:32.331400 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:53:32.331400 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 031a03be-3f3b-46dd-944c-6e68a9d8b09a could not be found. Oct 24 08:53:32.331400 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:53:32.332550 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-643e1154-0408-4f2e-a2ab-d1f77cfd0b07 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Returning 404 to user: Instance 031a03be-3f3b-46dd-944c-6e68a9d8b09a could not be found. {{(pid=125165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:53:32.332550 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-643e1154-0408-4f2e-a2ab-d1f77cfd0b07 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 404 len: 111 microversion: 2.1 time: 0.035095 Oct 24 08:53:32.332550 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 340/680] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:32 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:53:32.338596 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-ce9bbb08-28be-4ea6-be45-0c343c71402c tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '.version_select at 0x7f7ef1537790>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:32.358403 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-ce9bbb08-28be-4ea6-be45-0c343c71402c tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1066450027" status: 202 len: 0 microversion: 2.1 time: 0.024147 Oct 24 08:53:32.359146 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 341/681] 10.222.0.26 () {58 vars in 1221 bytes} [Mon Oct 24 08:53:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1066450027 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:53:33.010353 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-5ea2bc09-080c-46c2-96e0-6e84fdc24e56 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Action: 'create', calling method: .version_select at 0x7f7ef16575e0>, body: {"keypair": {"name": "tempest-keypair-958381151", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOd+qBqCiVArhrOMkH7p3e31egiZ2wFXH5ws+7FjAf6axMcaF2Ri0DLZ4cAcbDbrdviiiB3IpbpwRb4fNF5yPwAhMy8hET1kOKNzFJSGt5MyfroRGa6Wvv6GogEQLDbbMw=="}} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:33.026754 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.quota [None req-5ea2bc09-080c-46c2-96e0-6e84fdc24e56 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Getting quotas for project e3b77fd80fd84c29b4581fda1ff8cef9. Resources: {'key_pairs'} {{(pid=125165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:53:33.030741 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.quota [None req-5ea2bc09-080c-46c2-96e0-6e84fdc24e56 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Getting quotas for user 7d793a1f26a3467ea8119e27e3394371 and project e3b77fd80fd84c29b4581fda1ff8cef9. Resources: {'key_pairs'} {{(pid=125165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:53:33.055220 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-5ea2bc09-080c-46c2-96e0-6e84fdc24e56 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048812 Oct 24 08:53:33.055795 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 341/682] 10.222.0.26 () {60 vars in 1159 bytes} [Mon Oct 24 08:53:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:34.370076 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-1a1dc910-aa45-4e6f-b62e-012c210b7077 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-497120909", "imageRef": "7eef2d62-12dc-4746-9cbd-870797d39b4d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6bd93b93-0fdc-46fa-884b-c5f169b8b0e5"}], "security_groups": [{"name": "tempest-securitygroup--1196717403"}], "key_name": "tempest-keypair-958381151", "user_data": "}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:34.475202 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.network.neutron [None req-1a1dc910-aa45-4e6f-b62e-012c210b7077 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] validate_networks() for [('6bd93b93-0fdc-46fa-884b-c5f169b8b0e5', None, None, None, None, None)] {{(pid=125164) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:53:34.959810 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-1a1dc910-aa45-4e6f-b62e-012c210b7077 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Flavor limits 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:53:34.960241 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-1a1dc910-aa45-4e6f-b62e-012c210b7077 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Image limits 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:53:34.960717 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-1a1dc910-aa45-4e6f-b62e-012c210b7077 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Flavor pref 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:53:34.961122 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-1a1dc910-aa45-4e6f-b62e-012c210b7077 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Image pref 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:53:34.961535 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-1a1dc910-aa45-4e6f-b62e-012c210b7077 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:53:34.970991 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1a1dc910-aa45-4e6f-b62e-012c210b7077 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:34.971481 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1a1dc910-aa45-4e6f-b62e-012c210b7077 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:34.971918 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1a1dc910-aa45-4e6f-b62e-012c210b7077 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:34.972705 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1a1dc910-aa45-4e6f-b62e-012c210b7077 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:34.973142 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1a1dc910-aa45-4e6f-b62e-012c210b7077 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:34.973540 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1a1dc910-aa45-4e6f-b62e-012c210b7077 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:34.990201 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.quota [None req-1a1dc910-aa45-4e6f-b62e-012c210b7077 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Getting quotas for project e3b77fd80fd84c29b4581fda1ff8cef9. Resources: {'ram', 'cores', 'instances'} {{(pid=125164) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:53:34.994404 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.quota [None req-1a1dc910-aa45-4e6f-b62e-012c210b7077 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Getting quotas for user 7d793a1f26a3467ea8119e27e3394371 and project e3b77fd80fd84c29b4581fda1ff8cef9. Resources: {'ram', 'cores', 'instances'} {{(pid=125164) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:53:35.005824 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-1a1dc910-aa45-4e6f-b62e-012c210b7077 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Going to run 1 instances... {{(pid=125164) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:53:35.008254 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-1a1dc910-aa45-4e6f-b62e-012c210b7077 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 575d6bbd-9138-4599-8ffe-06b113b9ea99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7eef2d62-12dc-4746-9cbd-870797d39b4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125164) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:53:35.059835 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-1a1dc910-aa45-4e6f-b62e-012c210b7077 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.694120 Oct 24 08:53:35.060485 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 342/683] 10.222.0.26 () {60 vars in 1147 bytes} [Mon Oct 24 08:53:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:53:35.072009 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-7ff13353-308c-4458-8f82-1c65497a9c60 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:35.072580 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-7ff13353-308c-4458-8f82-1c65497a9c60 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 575d6bbd-9138-4599-8ffe-06b113b9ea99] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:35.126804 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-7ff13353-308c-4458-8f82-1c65497a9c60 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:35.134547 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-7ff13353-308c-4458-8f82-1c65497a9c60 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99" status: 200 len: 1236 microversion: 2.1 time: 0.066486 Oct 24 08:53:35.135185 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 342/684] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:35 2022] GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99 => generated 1236 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:36.158216 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-55bcf86f-5ff1-4078-97fd-408df4f2a31d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:36.158831 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-55bcf86f-5ff1-4078-97fd-408df4f2a31d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 575d6bbd-9138-4599-8ffe-06b113b9ea99] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:36.166184 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-55bcf86f-5ff1-4078-97fd-408df4f2a31d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:36.166595 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-55bcf86f-5ff1-4078-97fd-408df4f2a31d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:36.167065 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-55bcf86f-5ff1-4078-97fd-408df4f2a31d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:36.167744 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-55bcf86f-5ff1-4078-97fd-408df4f2a31d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:36.168190 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-55bcf86f-5ff1-4078-97fd-408df4f2a31d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:36.168604 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-55bcf86f-5ff1-4078-97fd-408df4f2a31d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:36.229283 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-55bcf86f-5ff1-4078-97fd-408df4f2a31d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:36.237332 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-55bcf86f-5ff1-4078-97fd-408df4f2a31d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99" status: 200 len: 1288 microversion: 2.1 time: 0.083598 Oct 24 08:53:36.237881 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 343/685] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:36 2022] GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99 => generated 1288 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:37.260071 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-c422dd7a-a9dd-4201-b6ed-1a49dc22ceb9 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:37.260770 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-c422dd7a-a9dd-4201-b6ed-1a49dc22ceb9 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 575d6bbd-9138-4599-8ffe-06b113b9ea99] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:37.273600 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c422dd7a-a9dd-4201-b6ed-1a49dc22ceb9 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:37.274189 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c422dd7a-a9dd-4201-b6ed-1a49dc22ceb9 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:37.274660 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c422dd7a-a9dd-4201-b6ed-1a49dc22ceb9 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:37.275614 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c422dd7a-a9dd-4201-b6ed-1a49dc22ceb9 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:37.276053 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c422dd7a-a9dd-4201-b6ed-1a49dc22ceb9 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:37.276498 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c422dd7a-a9dd-4201-b6ed-1a49dc22ceb9 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:37.492627 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-c422dd7a-a9dd-4201-b6ed-1a49dc22ceb9 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:37.500582 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-c422dd7a-a9dd-4201-b6ed-1a49dc22ceb9 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99" status: 200 len: 1362 microversion: 2.1 time: 0.244419 Oct 24 08:53:37.501223 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 343/686] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:37 2022] GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99 => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:38.053267 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-52e5965b-7303-4f71-97fd-60bd7a0d6b34 req-57c00d50-fb07-47d9-830d-586a11858e80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "575d6bbd-9138-4599-8ffe-06b113b9ea99", "tag": "939fa432-6068-44bb-9ea5-4b0cc46ce363"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:38.064832 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-52e5965b-7303-4f71-97fd-60bd7a0d6b34 req-57c00d50-fb07-47d9-830d-586a11858e80 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:38.065390 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-52e5965b-7303-4f71-97fd-60bd7a0d6b34 req-57c00d50-fb07-47d9-830d-586a11858e80 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:38.066471 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-52e5965b-7303-4f71-97fd-60bd7a0d6b34 req-57c00d50-fb07-47d9-830d-586a11858e80 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:38.077965 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-52e5965b-7303-4f71-97fd-60bd7a0d6b34 req-57c00d50-fb07-47d9-830d-586a11858e80 service nova] Creating event network-changed:939fa432-6068-44bb-9ea5-4b0cc46ce363 for instance 575d6bbd-9138-4599-8ffe-06b113b9ea99 on hv-cinder-maste Oct 24 08:53:38.082887 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-52e5965b-7303-4f71-97fd-60bd7a0d6b34 req-57c00d50-fb07-47d9-830d-586a11858e80 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038789 Oct 24 08:53:38.083478 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 344/687] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:38.524366 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-90b99638-8413-4af2-bccd-171e25685ae4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:38.525681 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-90b99638-8413-4af2-bccd-171e25685ae4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 575d6bbd-9138-4599-8ffe-06b113b9ea99] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:38.531720 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-90b99638-8413-4af2-bccd-171e25685ae4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:38.532125 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-90b99638-8413-4af2-bccd-171e25685ae4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:38.532554 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-90b99638-8413-4af2-bccd-171e25685ae4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:38.533332 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-90b99638-8413-4af2-bccd-171e25685ae4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:38.533776 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-90b99638-8413-4af2-bccd-171e25685ae4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:38.534187 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-90b99638-8413-4af2-bccd-171e25685ae4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:38.666131 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-90b99638-8413-4af2-bccd-171e25685ae4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:38.677357 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-90b99638-8413-4af2-bccd-171e25685ae4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99" status: 200 len: 1362 microversion: 2.1 time: 0.156846 Oct 24 08:53:38.677915 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 344/688] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:38 2022] GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:39.705653 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-86ae73c7-bd2a-4143-9eec-9f720d0441ae tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:39.706392 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-86ae73c7-bd2a-4143-9eec-9f720d0441ae tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 575d6bbd-9138-4599-8ffe-06b113b9ea99] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:39.713361 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-86ae73c7-bd2a-4143-9eec-9f720d0441ae tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:39.713877 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-86ae73c7-bd2a-4143-9eec-9f720d0441ae tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:39.714342 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-86ae73c7-bd2a-4143-9eec-9f720d0441ae tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:39.715105 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-86ae73c7-bd2a-4143-9eec-9f720d0441ae tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:39.715583 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-86ae73c7-bd2a-4143-9eec-9f720d0441ae tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:39.716033 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-86ae73c7-bd2a-4143-9eec-9f720d0441ae tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:39.855109 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-86ae73c7-bd2a-4143-9eec-9f720d0441ae tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:39.863481 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-86ae73c7-bd2a-4143-9eec-9f720d0441ae tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99" status: 200 len: 1362 microversion: 2.1 time: 0.165522 Oct 24 08:53:39.864088 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 345/689] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:39 2022] GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:40.890630 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-46d4f28d-aa42-4c57-8b24-d8d67e28dec0 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:40.891635 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-46d4f28d-aa42-4c57-8b24-d8d67e28dec0 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 575d6bbd-9138-4599-8ffe-06b113b9ea99] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:40.901903 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-46d4f28d-aa42-4c57-8b24-d8d67e28dec0 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:40.902704 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-46d4f28d-aa42-4c57-8b24-d8d67e28dec0 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:40.903478 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-46d4f28d-aa42-4c57-8b24-d8d67e28dec0 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:40.904662 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-46d4f28d-aa42-4c57-8b24-d8d67e28dec0 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:40.905457 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-46d4f28d-aa42-4c57-8b24-d8d67e28dec0 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:40.906155 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-46d4f28d-aa42-4c57-8b24-d8d67e28dec0 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:41.070927 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-46d4f28d-aa42-4c57-8b24-d8d67e28dec0 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:41.079116 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-46d4f28d-aa42-4c57-8b24-d8d67e28dec0 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99" status: 200 len: 1362 microversion: 2.1 time: 0.194778 Oct 24 08:53:41.079879 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 345/690] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:40 2022] GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99 => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:42.105037 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-3afe0133-150c-4ccb-810b-4a3ea0e76c09 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:42.106074 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-3afe0133-150c-4ccb-810b-4a3ea0e76c09 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 575d6bbd-9138-4599-8ffe-06b113b9ea99] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:42.114315 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3afe0133-150c-4ccb-810b-4a3ea0e76c09 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:42.114847 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3afe0133-150c-4ccb-810b-4a3ea0e76c09 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:42.115286 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3afe0133-150c-4ccb-810b-4a3ea0e76c09 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:42.116018 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3afe0133-150c-4ccb-810b-4a3ea0e76c09 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:42.116532 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3afe0133-150c-4ccb-810b-4a3ea0e76c09 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:42.116852 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3afe0133-150c-4ccb-810b-4a3ea0e76c09 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:42.490634 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-3afe0133-150c-4ccb-810b-4a3ea0e76c09 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:42.498347 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-3afe0133-150c-4ccb-810b-4a3ea0e76c09 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99" status: 200 len: 1362 microversion: 2.1 time: 0.399601 Oct 24 08:53:42.498944 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 346/691] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:42 2022] GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99 => generated 1362 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:43.525278 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-0a2144b5-fe91-4b90-a1e4-d5e45b322a55 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:43.526361 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-0a2144b5-fe91-4b90-a1e4-d5e45b322a55 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 575d6bbd-9138-4599-8ffe-06b113b9ea99] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:43.536707 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0a2144b5-fe91-4b90-a1e4-d5e45b322a55 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:43.537400 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0a2144b5-fe91-4b90-a1e4-d5e45b322a55 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:43.538112 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0a2144b5-fe91-4b90-a1e4-d5e45b322a55 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:43.539298 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0a2144b5-fe91-4b90-a1e4-d5e45b322a55 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:43.540083 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0a2144b5-fe91-4b90-a1e4-d5e45b322a55 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:43.540779 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0a2144b5-fe91-4b90-a1e4-d5e45b322a55 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:43.545419 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:43.685540 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-0a2144b5-fe91-4b90-a1e4-d5e45b322a55 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:43.693826 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-0a2144b5-fe91-4b90-a1e4-d5e45b322a55 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99" status: 200 len: 1362 microversion: 2.1 time: 0.174978 Oct 24 08:53:43.694391 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 346/692] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:43 2022] GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:53:43.999440 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-01488c65-070a-43c1-a685-a20603e68213 req-d324b541-611c-42b9-9817-14726d373c3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "575d6bbd-9138-4599-8ffe-06b113b9ea99", "name": "network-vif-plugged", "status": "completed", "tag": "939fa432-6068-44bb-9ea5-4b0cc46ce363"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:44.008955 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-01488c65-070a-43c1-a685-a20603e68213 req-d324b541-611c-42b9-9817-14726d373c3d service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:44.009425 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-01488c65-070a-43c1-a685-a20603e68213 req-d324b541-611c-42b9-9817-14726d373c3d service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:44.009839 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-01488c65-070a-43c1-a685-a20603e68213 req-d324b541-611c-42b9-9817-14726d373c3d service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:44.012444 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:44.022626 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-01488c65-070a-43c1-a685-a20603e68213 req-d324b541-611c-42b9-9817-14726d373c3d service nova] Creating event network-vif-plugged:939fa432-6068-44bb-9ea5-4b0cc46ce363 for instance 575d6bbd-9138-4599-8ffe-06b113b9ea99 on hv-cinder-maste Oct 24 08:53:44.027596 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-01488c65-070a-43c1-a685-a20603e68213 req-d324b541-611c-42b9-9817-14726d373c3d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157146 Oct 24 08:53:44.028182 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 347/693] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:44.720764 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-ef0b2b19-bdee-4456-ac69-de9c8ddb951e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:44.721429 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-ef0b2b19-bdee-4456-ac69-de9c8ddb951e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 575d6bbd-9138-4599-8ffe-06b113b9ea99] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:44.728744 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ef0b2b19-bdee-4456-ac69-de9c8ddb951e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:44.729321 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ef0b2b19-bdee-4456-ac69-de9c8ddb951e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:44.729829 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ef0b2b19-bdee-4456-ac69-de9c8ddb951e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:44.730633 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ef0b2b19-bdee-4456-ac69-de9c8ddb951e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:44.731205 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ef0b2b19-bdee-4456-ac69-de9c8ddb951e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:44.731704 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ef0b2b19-bdee-4456-ac69-de9c8ddb951e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:44.866464 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-ef0b2b19-bdee-4456-ac69-de9c8ddb951e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:44.877818 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-ef0b2b19-bdee-4456-ac69-de9c8ddb951e tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99" status: 200 len: 1362 microversion: 2.1 time: 0.163807 Oct 24 08:53:44.878387 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 347/694] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:44 2022] GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:45.898258 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell0:SELECT=2 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:45.899071 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell0:SELECT=6 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:45.903795 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-09c2507d-08aa-4c9f-aa6c-23cd1ff531fc tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:45.904500 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-09c2507d-08aa-4c9f-aa6c-23cd1ff531fc tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 575d6bbd-9138-4599-8ffe-06b113b9ea99] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:45.912140 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-09c2507d-08aa-4c9f-aa6c-23cd1ff531fc tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:45.912623 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-09c2507d-08aa-4c9f-aa6c-23cd1ff531fc tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:45.913052 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-09c2507d-08aa-4c9f-aa6c-23cd1ff531fc tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:45.913737 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-09c2507d-08aa-4c9f-aa6c-23cd1ff531fc tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:45.914186 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-09c2507d-08aa-4c9f-aa6c-23cd1ff531fc tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:45.914607 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-09c2507d-08aa-4c9f-aa6c-23cd1ff531fc tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:46.048713 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-09c2507d-08aa-4c9f-aa6c-23cd1ff531fc tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:46.060429 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-09c2507d-08aa-4c9f-aa6c-23cd1ff531fc tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99" status: 200 len: 1548 microversion: 2.1 time: 0.163404 Oct 24 08:53:46.061251 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 348/695] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:45 2022] GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99 => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:46.084029 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-84e3963b-8000-438e-bdeb-d10d254d9d56 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:46.084560 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-84e3963b-8000-438e-bdeb-d10d254d9d56 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 575d6bbd-9138-4599-8ffe-06b113b9ea99] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:46.086345 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell0:SELECT=6 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:46.091799 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-84e3963b-8000-438e-bdeb-d10d254d9d56 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:46.092254 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-84e3963b-8000-438e-bdeb-d10d254d9d56 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:46.092680 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-84e3963b-8000-438e-bdeb-d10d254d9d56 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:46.093365 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-84e3963b-8000-438e-bdeb-d10d254d9d56 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:46.093810 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-84e3963b-8000-438e-bdeb-d10d254d9d56 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:46.094231 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-84e3963b-8000-438e-bdeb-d10d254d9d56 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:46.172647 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-84e3963b-8000-438e-bdeb-d10d254d9d56 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092421 Oct 24 08:53:46.173237 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 348/696] 10.222.0.26 () {58 vars in 1275 bytes} [Mon Oct 24 08:53:46 2022] GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:47.139941 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-0be1bd88-967f-48c7-ac28-4f934b75a7ea req-b1195cf5-6655-4491-bfed-9858dbb99609 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "575d6bbd-9138-4599-8ffe-06b113b9ea99", "tag": "939fa432-6068-44bb-9ea5-4b0cc46ce363"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:53:47.149812 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-0be1bd88-967f-48c7-ac28-4f934b75a7ea req-b1195cf5-6655-4491-bfed-9858dbb99609 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:47.150287 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-0be1bd88-967f-48c7-ac28-4f934b75a7ea req-b1195cf5-6655-4491-bfed-9858dbb99609 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:47.150729 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-0be1bd88-967f-48c7-ac28-4f934b75a7ea req-b1195cf5-6655-4491-bfed-9858dbb99609 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:47.163909 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-0be1bd88-967f-48c7-ac28-4f934b75a7ea req-b1195cf5-6655-4491-bfed-9858dbb99609 service nova] Creating event network-changed:939fa432-6068-44bb-9ea5-4b0cc46ce363 for instance 575d6bbd-9138-4599-8ffe-06b113b9ea99 on hv-cinder-maste Oct 24 08:53:47.168833 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-0be1bd88-967f-48c7-ac28-4f934b75a7ea req-b1195cf5-6655-4491-bfed-9858dbb99609 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032588 Oct 24 08:53:47.169418 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 349/697] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:53:54.197266 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-a0859e4f-75cc-4d78-88bf-1eed44d7e317 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:54.197930 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-a0859e4f-75cc-4d78-88bf-1eed44d7e317 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:54.200470 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:54.207673 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a0859e4f-75cc-4d78-88bf-1eed44d7e317 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:54.208154 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a0859e4f-75cc-4d78-88bf-1eed44d7e317 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:54.208589 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a0859e4f-75cc-4d78-88bf-1eed44d7e317 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:54.209276 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a0859e4f-75cc-4d78-88bf-1eed44d7e317 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:54.209726 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a0859e4f-75cc-4d78-88bf-1eed44d7e317 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:54.210146 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a0859e4f-75cc-4d78-88bf-1eed44d7e317 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:54.297472 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.objects.instance [None req-a0859e4f-75cc-4d78-88bf-1eed44d7e317 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lazy-loading 'services' on Instance uuid f891147d-0b78-40f9-a17c-e1c9dbbc9f74 {{(pid=125165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:53:54.370999 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-a0859e4f-75cc-4d78-88bf-1eed44d7e317 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74/os-volume_attachments/3ff9a9f1-f85f-4d3f-912b-6497606a6b26" status: 202 len: 0 microversion: 2.1 time: 0.178963 Oct 24 08:53:54.371605 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 349/698] 10.222.0.26 () {58 vars in 1416 bytes} [Mon Oct 24 08:53:54 2022] DELETE /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74/os-volume_attachments/3ff9a9f1-f85f-4d3f-912b-6497606a6b26 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:53:54.381473 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-41ef2839-25fa-4e67-8385-ba50f67bee79 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:54.383816 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-41ef2839-25fa-4e67-8385-ba50f67bee79 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:54.385849 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:54.391365 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-41ef2839-25fa-4e67-8385-ba50f67bee79 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:54.391866 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-41ef2839-25fa-4e67-8385-ba50f67bee79 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:54.392422 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-41ef2839-25fa-4e67-8385-ba50f67bee79 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:54.393142 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-41ef2839-25fa-4e67-8385-ba50f67bee79 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:54.393615 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-41ef2839-25fa-4e67-8385-ba50f67bee79 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:54.394034 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-41ef2839-25fa-4e67-8385-ba50f67bee79 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:54.425914 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-41ef2839-25fa-4e67-8385-ba50f67bee79 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048909 Oct 24 08:53:54.430546 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 350/699] 10.222.0.26 () {58 vars in 1302 bytes} [Mon Oct 24 08:53:54 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:53:55.444082 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-bce46565-be26-4714-bc7c-199eb7e7b3f9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:55.448039 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-bce46565-be26-4714-bc7c-199eb7e7b3f9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:55.457142 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bce46565-be26-4714-bc7c-199eb7e7b3f9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:55.457627 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bce46565-be26-4714-bc7c-199eb7e7b3f9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:55.458058 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bce46565-be26-4714-bc7c-199eb7e7b3f9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:55.458755 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bce46565-be26-4714-bc7c-199eb7e7b3f9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:55.459235 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bce46565-be26-4714-bc7c-199eb7e7b3f9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:55.459645 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bce46565-be26-4714-bc7c-199eb7e7b3f9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:55.488691 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-bce46565-be26-4714-bc7c-199eb7e7b3f9 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052416 Oct 24 08:53:55.489271 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 350/700] 10.222.0.26 () {58 vars in 1302 bytes} [Mon Oct 24 08:53:55 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:53:55.568414 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-f649b2d9-8efc-4b6c-8913-740b639724e0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:55.568967 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-f649b2d9-8efc-4b6c-8913-740b639724e0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:55.576076 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f649b2d9-8efc-4b6c-8913-740b639724e0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:55.576554 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f649b2d9-8efc-4b6c-8913-740b639724e0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:55.576998 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f649b2d9-8efc-4b6c-8913-740b639724e0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:55.577677 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f649b2d9-8efc-4b6c-8913-740b639724e0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:55.578122 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f649b2d9-8efc-4b6c-8913-740b639724e0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:55.578549 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f649b2d9-8efc-4b6c-8913-740b639724e0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:55.603674 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-f649b2d9-8efc-4b6c-8913-740b639724e0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Going to try to terminate instance {{(pid=125164) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:53:55.681735 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-f649b2d9-8efc-4b6c-8913-740b639724e0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 204 len: 0 microversion: 2.1 time: 0.116727 Oct 24 08:53:55.682351 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 351/701] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Oct 24 08:53:55 2022] DELETE /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:53:55.693125 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-fb960e20-3285-4e48-b62b-0e7ed1d835c1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:55.694135 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-fb960e20-3285-4e48-b62b-0e7ed1d835c1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:55.703812 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-fb960e20-3285-4e48-b62b-0e7ed1d835c1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:55.704423 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-fb960e20-3285-4e48-b62b-0e7ed1d835c1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:55.705039 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-fb960e20-3285-4e48-b62b-0e7ed1d835c1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:55.705749 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-fb960e20-3285-4e48-b62b-0e7ed1d835c1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:55.706203 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-fb960e20-3285-4e48-b62b-0e7ed1d835c1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:55.706626 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-fb960e20-3285-4e48-b62b-0e7ed1d835c1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:55.851563 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-fb960e20-3285-4e48-b62b-0e7ed1d835c1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:55.859402 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-fb960e20-3285-4e48-b62b-0e7ed1d835c1 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1689 microversion: 2.1 time: 0.172584 Oct 24 08:53:55.859964 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 351/702] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:55 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1689 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:56.886564 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-b1f78839-a911-4897-8dcd-1e18ac00df33 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:56.887738 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-b1f78839-a911-4897-8dcd-1e18ac00df33 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:56.896303 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b1f78839-a911-4897-8dcd-1e18ac00df33 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:56.896786 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b1f78839-a911-4897-8dcd-1e18ac00df33 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:56.897217 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b1f78839-a911-4897-8dcd-1e18ac00df33 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:56.897895 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b1f78839-a911-4897-8dcd-1e18ac00df33 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:56.898340 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b1f78839-a911-4897-8dcd-1e18ac00df33 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:56.898755 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b1f78839-a911-4897-8dcd-1e18ac00df33 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:57.034373 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-b1f78839-a911-4897-8dcd-1e18ac00df33 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:57.046230 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-b1f78839-a911-4897-8dcd-1e18ac00df33 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1689 microversion: 2.1 time: 0.166156 Oct 24 08:53:57.047007 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 352/703] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:56 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:58.069019 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-a9b8d1db-ab0f-4e43-8f87-fc2d2f00c518 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:58.069572 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-a9b8d1db-ab0f-4e43-8f87-fc2d2f00c518 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:58.075926 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a9b8d1db-ab0f-4e43-8f87-fc2d2f00c518 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:58.076410 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a9b8d1db-ab0f-4e43-8f87-fc2d2f00c518 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:58.076840 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a9b8d1db-ab0f-4e43-8f87-fc2d2f00c518 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:58.077491 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a9b8d1db-ab0f-4e43-8f87-fc2d2f00c518 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:58.077957 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a9b8d1db-ab0f-4e43-8f87-fc2d2f00c518 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:58.078372 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a9b8d1db-ab0f-4e43-8f87-fc2d2f00c518 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:58.206693 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a9b8d1db-ab0f-4e43-8f87-fc2d2f00c518 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:58.214548 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-a9b8d1db-ab0f-4e43-8f87-fc2d2f00c518 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1689 microversion: 2.1 time: 0.149653 Oct 24 08:53:58.215162 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 352/704] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:58 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:53:59.242103 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-b87adbec-382b-4e9e-a4b7-6c394b4b0b3c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:53:59.243145 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-b87adbec-382b-4e9e-a4b7-6c394b4b0b3c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:53:59.253849 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b87adbec-382b-4e9e-a4b7-6c394b4b0b3c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:59.254645 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b87adbec-382b-4e9e-a4b7-6c394b4b0b3c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:59.255422 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b87adbec-382b-4e9e-a4b7-6c394b4b0b3c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:59.256563 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b87adbec-382b-4e9e-a4b7-6c394b4b0b3c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:53:59.257297 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b87adbec-382b-4e9e-a4b7-6c394b4b0b3c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:53:59.257993 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b87adbec-382b-4e9e-a4b7-6c394b4b0b3c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:53:59.392428 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-b87adbec-382b-4e9e-a4b7-6c394b4b0b3c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:53:59.400293 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-b87adbec-382b-4e9e-a4b7-6c394b4b0b3c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1689 microversion: 2.1 time: 0.164778 Oct 24 08:53:59.400860 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 353/705] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:53:59 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:00.424416 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-2eb9ffa6-3421-4ff1-a07e-f471a72be45f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:00.425036 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-2eb9ffa6-3421-4ff1-a07e-f471a72be45f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:00.431369 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2eb9ffa6-3421-4ff1-a07e-f471a72be45f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:00.431887 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2eb9ffa6-3421-4ff1-a07e-f471a72be45f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:00.432425 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2eb9ffa6-3421-4ff1-a07e-f471a72be45f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:00.433115 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2eb9ffa6-3421-4ff1-a07e-f471a72be45f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:00.433681 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2eb9ffa6-3421-4ff1-a07e-f471a72be45f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:00.434346 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2eb9ffa6-3421-4ff1-a07e-f471a72be45f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:00.494647 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-2eb9ffa6-3421-4ff1-a07e-f471a72be45f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:00.502668 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-2eb9ffa6-3421-4ff1-a07e-f471a72be45f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 200 len: 1621 microversion: 2.1 time: 0.082961 Oct 24 08:54:00.503230 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 353/706] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:00 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 1621 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:00.585448 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-58c95cf8-af15-476f-be88-22861acf37a8 req-b93cf04f-83fd-4edb-98e9-0cbfb02c232d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f891147d-0b78-40f9-a17c-e1c9dbbc9f74", "name": "network-vif-deleted", "tag": "d190bfd0-e1fc-4a5c-9d6c-f84bdb6d2209"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:00.598032 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-58c95cf8-af15-476f-be88-22861acf37a8 req-b93cf04f-83fd-4edb-98e9-0cbfb02c232d service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:00.598595 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-58c95cf8-af15-476f-be88-22861acf37a8 req-b93cf04f-83fd-4edb-98e9-0cbfb02c232d service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:00.599126 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-58c95cf8-af15-476f-be88-22861acf37a8 req-b93cf04f-83fd-4edb-98e9-0cbfb02c232d service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:00.611180 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-58c95cf8-af15-476f-be88-22861acf37a8 req-b93cf04f-83fd-4edb-98e9-0cbfb02c232d service nova] Creating event network-vif-deleted:d190bfd0-e1fc-4a5c-9d6c-f84bdb6d2209 for instance f891147d-0b78-40f9-a17c-e1c9dbbc9f74 on hv-cinder-maste Oct 24 08:54:00.617793 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-58c95cf8-af15-476f-be88-22861acf37a8 req-b93cf04f-83fd-4edb-98e9-0cbfb02c232d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036310 Oct 24 08:54:00.618858 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 354/707] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:54:01.525656 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-c078db17-8857-4d64-8cd7-6e40edb1192e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:01.526263 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-c078db17-8857-4d64-8cd7-6e40edb1192e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f891147d-0b78-40f9-a17c-e1c9dbbc9f74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:01.532528 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c078db17-8857-4d64-8cd7-6e40edb1192e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:01.533046 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c078db17-8857-4d64-8cd7-6e40edb1192e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:01.533472 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c078db17-8857-4d64-8cd7-6e40edb1192e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:01.534154 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c078db17-8857-4d64-8cd7-6e40edb1192e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:01.534632 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c078db17-8857-4d64-8cd7-6e40edb1192e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:01.535079 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c078db17-8857-4d64-8cd7-6e40edb1192e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:01.549491 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.wsgi [None req-c078db17-8857-4d64-8cd7-6e40edb1192e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] HTTP exception thrown: Instance f891147d-0b78-40f9-a17c-e1c9dbbc9f74 could not be found. Oct 24 08:54:01.551145 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-c078db17-8857-4d64-8cd7-6e40edb1192e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Request method failure captured: Oct 24 08:54:01.551145 dv-cinder-master-3-smb devstack@n-api.service[125165]: request: GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 HTTP/1.1 Oct 24 08:54:01.551145 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept: application/json Oct 24 08:54:01.551145 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept-Encoding: identity Oct 24 08:54:01.551145 dv-cinder-master-3-smb devstack@n-api.service[125165]: Connection: close Oct 24 08:54:01.551145 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Length: 0 Oct 24 08:54:01.551145 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Type: application/json Oct 24 08:54:01.551145 dv-cinder-master-3-smb devstack@n-api.service[125165]: Host: 10.222.0.26 Oct 24 08:54:01.551145 dv-cinder-master-3-smb devstack@n-api.service[125165]: Openstack-System-Scope: None Oct 24 08:54:01.551145 dv-cinder-master-3-smb devstack@n-api.service[125165]: User-Agent: python-urllib3/1.26.12 Oct 24 08:54:01.551145 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Auth-Token: gAAAAABjVlE8fgt8TlV2Xk75DOKAirPHmxhZbk5PsnSOl8uKrHSmt8vLmZl9wsWtMWHbcvrINjM9NbHEp6Z2bqeDRmCulVrREKjtNSMRyV38Pb1ReI6MoKQRPQUQO_4JYRXXssXJ145YNsyFbdDiFmugxAp3rv3PlVN7Qyts1ETOZ8colLD_vTs Oct 24 08:54:01.551145 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Id: None Oct 24 08:54:01.551145 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Name: None Oct 24 08:54:01.551145 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Identity-Status: Confirmed Oct 24 08:54:01.551145 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Is-Admin-Project: True Oct 24 08:54:01.551145 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Id: default Oct 24 08:54:01.551145 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Name: Default Oct 24 08:54:01.551145 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Id: f063c719bcda47e6874437d32d284815 Oct 24 08:54:01.551145 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-577585278 Oct 24 08:54:01.551145 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Role: reader,member Oct 24 08:54:01.551145 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Roles: reader,member Oct 24 08:54:01.552663 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f063c719bcda47e6874437d32d284815", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f063c719bcda47e6874437d32d284815"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f063c719bcda47e6874437d32d284815"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f063c719bcda47e6874437d32d284815"}]}] Oct 24 08:54:01.552663 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant: tempest-ServerRescueNegativeTestJSON-577585278 Oct 24 08:54:01.552663 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Id: f063c719bcda47e6874437d32d284815 Oct 24 08:54:01.552663 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-577585278 Oct 24 08:54:01.552663 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User: tempest-ServerRescueNegativeTestJSON-577585278-project Oct 24 08:54:01.552663 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Id: default Oct 24 08:54:01.552663 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Name: Default Oct 24 08:54:01.552663 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Id: 8695364e58b04d829b12ae1b49757536 Oct 24 08:54:01.552663 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Name: tempest-ServerRescueNegativeTestJSON-577585278-project Oct 24 08:54:01.552663 dv-cinder-master-3-smb devstack@n-api.service[125165]: method: > Oct 24 08:54:01.552663 dv-cinder-master-3-smb devstack@n-api.service[125165]: exception: Instance f891147d-0b78-40f9-a17c-e1c9dbbc9f74 could not be found. Oct 24 08:54:01.552663 dv-cinder-master-3-smb devstack@n-api.service[125165]: action_args: {'id': 'f891147d-0b78-40f9-a17c-e1c9dbbc9f74'} Oct 24 08:54:01.553455 dv-cinder-master-3-smb devstack@n-api.service[125165]: {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:54:01.553455 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:01.553455 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:54:01.553455 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:54:01.553455 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:54:01.553455 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:54:01.553455 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:54:01.553455 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:54:01.553455 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:54:01.553455 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:54:01.553455 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f891147d-0b78-40f9-a17c-e1c9dbbc9f74 could not be found. Oct 24 08:54:01.553455 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:54:01.553455 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:54:01.553455 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:54:01.553455 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:01.553455 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:54:01.553455 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:54:01.553455 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:54:01.553455 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:54:01.553455 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:54:01.554673 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:54:01.554673 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:54:01.554673 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:54:01.554673 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:54:01.554673 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:54:01.554673 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:54:01.554673 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:54:01.554673 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f891147d-0b78-40f9-a17c-e1c9dbbc9f74 could not be found. Oct 24 08:54:01.554673 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:54:01.554673 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:54:01.554673 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:54:01.554673 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:01.554673 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:54:01.554673 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:54:01.554673 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:54:01.554673 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:54:01.554673 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f891147d-0b78-40f9-a17c-e1c9dbbc9f74 could not be found. Oct 24 08:54:01.554673 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:54:01.555785 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-c078db17-8857-4d64-8cd7-6e40edb1192e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Returning 404 to user: Instance f891147d-0b78-40f9-a17c-e1c9dbbc9f74 could not be found. {{(pid=125165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:54:01.555785 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-c078db17-8857-4d64-8cd7-6e40edb1192e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74" status: 404 len: 111 microversion: 2.1 time: 0.030831 Oct 24 08:54:01.555785 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 354/708] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:01 2022] GET /compute/v2.1/servers/f891147d-0b78-40f9-a17c-e1c9dbbc9f74 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:54:01.562171 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-788aaea8-aae7-44a6-a22a-e4f164c59c1d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '.version_select at 0x7f7ef15ece50>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:01.583731 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-788aaea8-aae7-44a6-a22a-e4f164c59c1d tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-998357312" status: 202 len: 0 microversion: 2.1 time: 0.025610 Oct 24 08:54:01.584334 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 355/709] 10.222.0.26 () {58 vars in 1218 bytes} [Mon Oct 24 08:54:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-998357312 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:54:04.529988 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-75da8833-3ac5-4947-a4ea-159a1489c36c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:04.530509 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-75da8833-3ac5-4947-a4ea-159a1489c36c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:04.536922 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-75da8833-3ac5-4947-a4ea-159a1489c36c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:04.537407 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-75da8833-3ac5-4947-a4ea-159a1489c36c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:04.537842 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-75da8833-3ac5-4947-a4ea-159a1489c36c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:04.538549 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-75da8833-3ac5-4947-a4ea-159a1489c36c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:04.539014 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-75da8833-3ac5-4947-a4ea-159a1489c36c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:04.539436 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-75da8833-3ac5-4947-a4ea-159a1489c36c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:04.564627 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-75da8833-3ac5-4947-a4ea-159a1489c36c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Going to try to terminate instance {{(pid=125165) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:54:04.644253 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-75da8833-3ac5-4947-a4ea-159a1489c36c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 204 len: 0 microversion: 2.1 time: 0.117814 Oct 24 08:54:04.645548 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 355/710] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Oct 24 08:54:04 2022] DELETE /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:54:04.654003 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-9f06ef7c-ec53-4f41-be32-01b41127ce8c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:04.654747 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-9f06ef7c-ec53-4f41-be32-01b41127ce8c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:04.661098 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9f06ef7c-ec53-4f41-be32-01b41127ce8c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:04.661607 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9f06ef7c-ec53-4f41-be32-01b41127ce8c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:04.662041 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9f06ef7c-ec53-4f41-be32-01b41127ce8c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:04.662747 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9f06ef7c-ec53-4f41-be32-01b41127ce8c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:04.663224 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9f06ef7c-ec53-4f41-be32-01b41127ce8c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:04.663649 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9f06ef7c-ec53-4f41-be32-01b41127ce8c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:04.796230 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-9f06ef7c-ec53-4f41-be32-01b41127ce8c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:04.804333 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-9f06ef7c-ec53-4f41-be32-01b41127ce8c tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1508 microversion: 2.1 time: 0.154710 Oct 24 08:54:04.804884 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 356/711] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:04 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:05.829012 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-1e021506-7cc3-4152-9d30-ba72dfb3db1f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:05.829780 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-1e021506-7cc3-4152-9d30-ba72dfb3db1f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:05.836597 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1e021506-7cc3-4152-9d30-ba72dfb3db1f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:05.837138 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1e021506-7cc3-4152-9d30-ba72dfb3db1f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:05.837623 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1e021506-7cc3-4152-9d30-ba72dfb3db1f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:05.838384 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1e021506-7cc3-4152-9d30-ba72dfb3db1f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:05.838927 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1e021506-7cc3-4152-9d30-ba72dfb3db1f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:05.839397 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1e021506-7cc3-4152-9d30-ba72dfb3db1f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:05.971099 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-1e021506-7cc3-4152-9d30-ba72dfb3db1f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:05.979200 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-1e021506-7cc3-4152-9d30-ba72dfb3db1f tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1508 microversion: 2.1 time: 0.154856 Oct 24 08:54:05.979771 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 356/712] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:05 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:06.830599 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-a0d43d9d-8b11-412e-b3f1-02ec31b17094 req-49ad72ad-ad47-4c53-b2fe-3419d26607e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca02e6b0-1ae6-407d-b554-7f96d1aa1726", "name": "network-vif-deleted", "tag": "251f4f85-a3d9-4ade-80a5-bbb88e814476"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:06.843240 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-a0d43d9d-8b11-412e-b3f1-02ec31b17094 req-49ad72ad-ad47-4c53-b2fe-3419d26607e6 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:06.843691 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-a0d43d9d-8b11-412e-b3f1-02ec31b17094 req-49ad72ad-ad47-4c53-b2fe-3419d26607e6 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:06.844125 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-a0d43d9d-8b11-412e-b3f1-02ec31b17094 req-49ad72ad-ad47-4c53-b2fe-3419d26607e6 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:06.857522 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-a0d43d9d-8b11-412e-b3f1-02ec31b17094 req-49ad72ad-ad47-4c53-b2fe-3419d26607e6 service nova] Creating event network-vif-deleted:251f4f85-a3d9-4ade-80a5-bbb88e814476 for instance ca02e6b0-1ae6-407d-b554-7f96d1aa1726 on hv-cinder-maste Oct 24 08:54:06.864563 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-a0d43d9d-8b11-412e-b3f1-02ec31b17094 req-49ad72ad-ad47-4c53-b2fe-3419d26607e6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037386 Oct 24 08:54:06.865168 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 357/713] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:54:07.006113 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-bdaf8fbf-c84d-49fe-867d-44da7b176cf7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:07.006988 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-bdaf8fbf-c84d-49fe-867d-44da7b176cf7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:07.015269 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bdaf8fbf-c84d-49fe-867d-44da7b176cf7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:07.015786 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bdaf8fbf-c84d-49fe-867d-44da7b176cf7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:07.016226 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bdaf8fbf-c84d-49fe-867d-44da7b176cf7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:07.016929 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bdaf8fbf-c84d-49fe-867d-44da7b176cf7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:07.017377 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bdaf8fbf-c84d-49fe-867d-44da7b176cf7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:07.017857 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bdaf8fbf-c84d-49fe-867d-44da7b176cf7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:07.051052 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bdaf8fbf-c84d-49fe-867d-44da7b176cf7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:07.051538 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bdaf8fbf-c84d-49fe-867d-44da7b176cf7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:07.051973 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bdaf8fbf-c84d-49fe-867d-44da7b176cf7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:07.052429 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.objects.instance [None req-bdaf8fbf-c84d-49fe-867d-44da7b176cf7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lazy-loading 'fault' on Instance uuid ca02e6b0-1ae6-407d-b554-7f96d1aa1726 {{(pid=125165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:54:07.096282 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-bdaf8fbf-c84d-49fe-867d-44da7b176cf7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:07.104250 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-bdaf8fbf-c84d-49fe-867d-44da7b176cf7 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 200 len: 1311 microversion: 2.1 time: 0.105433 Oct 24 08:54:07.104966 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 357/714] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:06 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 1311 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:08.133100 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-7a0c03d0-49f5-4794-b81d-fac10a283fcd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:08.134463 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-7a0c03d0-49f5-4794-b81d-fac10a283fcd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: ca02e6b0-1ae6-407d-b554-7f96d1aa1726] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:08.144897 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7a0c03d0-49f5-4794-b81d-fac10a283fcd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:08.145389 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7a0c03d0-49f5-4794-b81d-fac10a283fcd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:08.145823 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7a0c03d0-49f5-4794-b81d-fac10a283fcd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:08.146515 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7a0c03d0-49f5-4794-b81d-fac10a283fcd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:08.147010 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7a0c03d0-49f5-4794-b81d-fac10a283fcd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:08.147438 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7a0c03d0-49f5-4794-b81d-fac10a283fcd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:08.163028 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.wsgi [None req-7a0c03d0-49f5-4794-b81d-fac10a283fcd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] HTTP exception thrown: Instance ca02e6b0-1ae6-407d-b554-7f96d1aa1726 could not be found. Oct 24 08:54:08.164651 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-7a0c03d0-49f5-4794-b81d-fac10a283fcd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Request method failure captured: Oct 24 08:54:08.164651 dv-cinder-master-3-smb devstack@n-api.service[125164]: request: GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 HTTP/1.1 Oct 24 08:54:08.164651 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept: application/json Oct 24 08:54:08.164651 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept-Encoding: identity Oct 24 08:54:08.164651 dv-cinder-master-3-smb devstack@n-api.service[125164]: Connection: close Oct 24 08:54:08.164651 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Length: 0 Oct 24 08:54:08.164651 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Type: application/json Oct 24 08:54:08.164651 dv-cinder-master-3-smb devstack@n-api.service[125164]: Host: 10.222.0.26 Oct 24 08:54:08.164651 dv-cinder-master-3-smb devstack@n-api.service[125164]: Openstack-System-Scope: None Oct 24 08:54:08.164651 dv-cinder-master-3-smb devstack@n-api.service[125164]: User-Agent: python-urllib3/1.26.12 Oct 24 08:54:08.164651 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Auth-Token: gAAAAABjVlE8fgt8TlV2Xk75DOKAirPHmxhZbk5PsnSOl8uKrHSmt8vLmZl9wsWtMWHbcvrINjM9NbHEp6Z2bqeDRmCulVrREKjtNSMRyV38Pb1ReI6MoKQRPQUQO_4JYRXXssXJ145YNsyFbdDiFmugxAp3rv3PlVN7Qyts1ETOZ8colLD_vTs Oct 24 08:54:08.164651 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Id: None Oct 24 08:54:08.164651 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Name: None Oct 24 08:54:08.164651 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Identity-Status: Confirmed Oct 24 08:54:08.164651 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Is-Admin-Project: True Oct 24 08:54:08.164651 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Id: default Oct 24 08:54:08.164651 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Name: Default Oct 24 08:54:08.164651 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Id: f063c719bcda47e6874437d32d284815 Oct 24 08:54:08.164651 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-577585278 Oct 24 08:54:08.164651 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Role: reader,member Oct 24 08:54:08.164651 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Roles: reader,member Oct 24 08:54:08.166012 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f063c719bcda47e6874437d32d284815", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f063c719bcda47e6874437d32d284815"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f063c719bcda47e6874437d32d284815"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f063c719bcda47e6874437d32d284815"}]}] Oct 24 08:54:08.166012 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant: tempest-ServerRescueNegativeTestJSON-577585278 Oct 24 08:54:08.166012 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Id: f063c719bcda47e6874437d32d284815 Oct 24 08:54:08.166012 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-577585278 Oct 24 08:54:08.166012 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User: tempest-ServerRescueNegativeTestJSON-577585278-project Oct 24 08:54:08.166012 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Id: default Oct 24 08:54:08.166012 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Name: Default Oct 24 08:54:08.166012 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Id: 8695364e58b04d829b12ae1b49757536 Oct 24 08:54:08.166012 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Name: tempest-ServerRescueNegativeTestJSON-577585278-project Oct 24 08:54:08.166012 dv-cinder-master-3-smb devstack@n-api.service[125164]: method: > Oct 24 08:54:08.166012 dv-cinder-master-3-smb devstack@n-api.service[125164]: exception: Instance ca02e6b0-1ae6-407d-b554-7f96d1aa1726 could not be found. Oct 24 08:54:08.166012 dv-cinder-master-3-smb devstack@n-api.service[125164]: action_args: {'id': 'ca02e6b0-1ae6-407d-b554-7f96d1aa1726'} Oct 24 08:54:08.166844 dv-cinder-master-3-smb devstack@n-api.service[125164]: {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:54:08.166844 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:08.166844 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:54:08.166844 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:54:08.166844 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:54:08.166844 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:54:08.166844 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:54:08.166844 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:54:08.166844 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:54:08.166844 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:54:08.166844 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca02e6b0-1ae6-407d-b554-7f96d1aa1726 could not be found. Oct 24 08:54:08.166844 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:54:08.166844 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:54:08.166844 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:54:08.166844 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:08.166844 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:54:08.166844 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:54:08.166844 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:54:08.166844 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:54:08.166844 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:54:08.168162 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:54:08.168162 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:54:08.168162 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:54:08.168162 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:54:08.168162 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:54:08.168162 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:54:08.168162 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:54:08.168162 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca02e6b0-1ae6-407d-b554-7f96d1aa1726 could not be found. Oct 24 08:54:08.168162 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:54:08.168162 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:54:08.168162 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:54:08.168162 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:08.168162 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:54:08.168162 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:54:08.168162 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:54:08.168162 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:54:08.168162 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca02e6b0-1ae6-407d-b554-7f96d1aa1726 could not be found. Oct 24 08:54:08.168162 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:54:08.169205 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-7a0c03d0-49f5-4794-b81d-fac10a283fcd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Returning 404 to user: Instance ca02e6b0-1ae6-407d-b554-7f96d1aa1726 could not be found. {{(pid=125164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:54:08.169205 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-7a0c03d0-49f5-4794-b81d-fac10a283fcd tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726" status: 404 len: 111 microversion: 2.1 time: 0.041034 Oct 24 08:54:08.169205 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 358/715] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:08 2022] GET /compute/v2.1/servers/ca02e6b0-1ae6-407d-b554-7f96d1aa1726 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:54:08.175008 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-58fcb9f9-0acb-4aeb-9a6b-97a0fff9e887 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:08.175467 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-58fcb9f9-0acb-4aeb-9a6b-97a0fff9e887 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f2772d7f-d505-44ab-a062-58bd88bd49d3] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:08.181712 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-58fcb9f9-0acb-4aeb-9a6b-97a0fff9e887 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:08.182195 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-58fcb9f9-0acb-4aeb-9a6b-97a0fff9e887 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:08.182622 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-58fcb9f9-0acb-4aeb-9a6b-97a0fff9e887 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:08.183620 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-58fcb9f9-0acb-4aeb-9a6b-97a0fff9e887 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:08.184072 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-58fcb9f9-0acb-4aeb-9a6b-97a0fff9e887 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:08.184490 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-58fcb9f9-0acb-4aeb-9a6b-97a0fff9e887 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:08.209619 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-58fcb9f9-0acb-4aeb-9a6b-97a0fff9e887 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f2772d7f-d505-44ab-a062-58bd88bd49d3] Going to try to terminate instance {{(pid=125165) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:54:08.298666 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-58fcb9f9-0acb-4aeb-9a6b-97a0fff9e887 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3" status: 204 len: 0 microversion: 2.1 time: 0.127491 Oct 24 08:54:08.299430 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 358/716] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Oct 24 08:54:08 2022] DELETE /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:54:08.307667 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-7f0b10b1-9235-4580-888a-8ce330736925 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:08.308353 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-7f0b10b1-9235-4580-888a-8ce330736925 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f2772d7f-d505-44ab-a062-58bd88bd49d3] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:08.314595 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7f0b10b1-9235-4580-888a-8ce330736925 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:08.315209 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7f0b10b1-9235-4580-888a-8ce330736925 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:08.315672 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7f0b10b1-9235-4580-888a-8ce330736925 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:08.316400 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7f0b10b1-9235-4580-888a-8ce330736925 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:08.316856 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7f0b10b1-9235-4580-888a-8ce330736925 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:08.317283 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7f0b10b1-9235-4580-888a-8ce330736925 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:08.452870 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-7f0b10b1-9235-4580-888a-8ce330736925 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:08.461355 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-7f0b10b1-9235-4580-888a-8ce330736925 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3" status: 200 len: 1522 microversion: 2.1 time: 0.157606 Oct 24 08:54:08.461942 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 359/717] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:08 2022] GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:09.498064 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-30a36c0a-ffbb-4f8e-abee-88d31d24dee4 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:09.499257 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-30a36c0a-ffbb-4f8e-abee-88d31d24dee4 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f2772d7f-d505-44ab-a062-58bd88bd49d3] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:09.506602 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-30a36c0a-ffbb-4f8e-abee-88d31d24dee4 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:09.507120 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-30a36c0a-ffbb-4f8e-abee-88d31d24dee4 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:09.507555 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-30a36c0a-ffbb-4f8e-abee-88d31d24dee4 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:09.508242 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-30a36c0a-ffbb-4f8e-abee-88d31d24dee4 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:09.508722 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-30a36c0a-ffbb-4f8e-abee-88d31d24dee4 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:09.509178 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-30a36c0a-ffbb-4f8e-abee-88d31d24dee4 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:09.523857 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:09.642364 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-30a36c0a-ffbb-4f8e-abee-88d31d24dee4 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:09.650273 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-30a36c0a-ffbb-4f8e-abee-88d31d24dee4 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3" status: 200 len: 1522 microversion: 2.1 time: 0.159372 Oct 24 08:54:09.650857 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 359/718] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:09 2022] GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:10.676493 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-c8a5bb03-9c07-4b76-8367-3f469924a0c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:10.677176 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-c8a5bb03-9c07-4b76-8367-3f469924a0c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f2772d7f-d505-44ab-a062-58bd88bd49d3] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:10.685237 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c8a5bb03-9c07-4b76-8367-3f469924a0c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:10.685804 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c8a5bb03-9c07-4b76-8367-3f469924a0c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:10.686305 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c8a5bb03-9c07-4b76-8367-3f469924a0c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:10.687149 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c8a5bb03-9c07-4b76-8367-3f469924a0c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:10.687674 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c8a5bb03-9c07-4b76-8367-3f469924a0c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:10.688167 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c8a5bb03-9c07-4b76-8367-3f469924a0c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:10.829965 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-c8a5bb03-9c07-4b76-8367-3f469924a0c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:10.837974 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-c8a5bb03-9c07-4b76-8367-3f469924a0c0 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3" status: 200 len: 1522 microversion: 2.1 time: 0.167639 Oct 24 08:54:10.838510 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 360/719] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:10 2022] GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:11.349032 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-7be6c439-b61b-4633-ac3c-f104b4aab9b5 req-8ed59af6-5dfb-4232-a343-f6d0e59eccda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2772d7f-d505-44ab-a062-58bd88bd49d3", "name": "network-vif-deleted", "tag": "e84e11b7-68e1-423d-a896-f0d3e2146a03"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:11.360791 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-7be6c439-b61b-4633-ac3c-f104b4aab9b5 req-8ed59af6-5dfb-4232-a343-f6d0e59eccda service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:11.361546 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-7be6c439-b61b-4633-ac3c-f104b4aab9b5 req-8ed59af6-5dfb-4232-a343-f6d0e59eccda service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:11.361971 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-7be6c439-b61b-4633-ac3c-f104b4aab9b5 req-8ed59af6-5dfb-4232-a343-f6d0e59eccda service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:11.373438 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-7be6c439-b61b-4633-ac3c-f104b4aab9b5 req-8ed59af6-5dfb-4232-a343-f6d0e59eccda service nova] Creating event network-vif-deleted:e84e11b7-68e1-423d-a896-f0d3e2146a03 for instance f2772d7f-d505-44ab-a062-58bd88bd49d3 on hv-cinder-maste Oct 24 08:54:11.378796 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-7be6c439-b61b-4633-ac3c-f104b4aab9b5 req-8ed59af6-5dfb-4232-a343-f6d0e59eccda service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033325 Oct 24 08:54:11.379546 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 360/720] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:54:11.865071 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-ba9cd4a3-6006-40a7-ac62-9c7affe82f49 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:11.866055 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-ba9cd4a3-6006-40a7-ac62-9c7affe82f49 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f2772d7f-d505-44ab-a062-58bd88bd49d3] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:11.877113 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ba9cd4a3-6006-40a7-ac62-9c7affe82f49 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:11.877548 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ba9cd4a3-6006-40a7-ac62-9c7affe82f49 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:11.877982 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ba9cd4a3-6006-40a7-ac62-9c7affe82f49 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:11.878666 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ba9cd4a3-6006-40a7-ac62-9c7affe82f49 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:11.879275 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ba9cd4a3-6006-40a7-ac62-9c7affe82f49 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:11.879698 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ba9cd4a3-6006-40a7-ac62-9c7affe82f49 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:11.910814 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ba9cd4a3-6006-40a7-ac62-9c7affe82f49 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:11.911292 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ba9cd4a3-6006-40a7-ac62-9c7affe82f49 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:11.911728 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ba9cd4a3-6006-40a7-ac62-9c7affe82f49 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:11.912164 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.objects.instance [None req-ba9cd4a3-6006-40a7-ac62-9c7affe82f49 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lazy-loading 'fault' on Instance uuid f2772d7f-d505-44ab-a062-58bd88bd49d3 {{(pid=125164) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:54:11.953869 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-ba9cd4a3-6006-40a7-ac62-9c7affe82f49 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8695364e58b04d829b12ae1b49757536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f063c719bcda47e6874437d32d284815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:11.962022 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-ba9cd4a3-6006-40a7-ac62-9c7affe82f49 tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3" status: 200 len: 1312 microversion: 2.1 time: 0.103473 Oct 24 08:54:11.962601 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 361/721] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:11 2022] GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3 => generated 1312 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:12.985761 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-f32da85c-78a6-40f7-8da0-ec720f68000e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:12.986502 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-f32da85c-78a6-40f7-8da0-ec720f68000e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] [instance: f2772d7f-d505-44ab-a062-58bd88bd49d3] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:12.993121 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f32da85c-78a6-40f7-8da0-ec720f68000e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:12.993597 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f32da85c-78a6-40f7-8da0-ec720f68000e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:12.994027 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f32da85c-78a6-40f7-8da0-ec720f68000e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:12.994746 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f32da85c-78a6-40f7-8da0-ec720f68000e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:12.995192 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f32da85c-78a6-40f7-8da0-ec720f68000e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:12.995615 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f32da85c-78a6-40f7-8da0-ec720f68000e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:13.009013 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.wsgi [None req-f32da85c-78a6-40f7-8da0-ec720f68000e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] HTTP exception thrown: Instance f2772d7f-d505-44ab-a062-58bd88bd49d3 could not be found. Oct 24 08:54:13.010655 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-f32da85c-78a6-40f7-8da0-ec720f68000e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Request method failure captured: Oct 24 08:54:13.010655 dv-cinder-master-3-smb devstack@n-api.service[125165]: request: GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3 HTTP/1.1 Oct 24 08:54:13.010655 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept: application/json Oct 24 08:54:13.010655 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept-Encoding: identity Oct 24 08:54:13.010655 dv-cinder-master-3-smb devstack@n-api.service[125165]: Connection: close Oct 24 08:54:13.010655 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Length: 0 Oct 24 08:54:13.010655 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Type: application/json Oct 24 08:54:13.010655 dv-cinder-master-3-smb devstack@n-api.service[125165]: Host: 10.222.0.26 Oct 24 08:54:13.010655 dv-cinder-master-3-smb devstack@n-api.service[125165]: Openstack-System-Scope: None Oct 24 08:54:13.010655 dv-cinder-master-3-smb devstack@n-api.service[125165]: User-Agent: python-urllib3/1.26.12 Oct 24 08:54:13.010655 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Auth-Token: gAAAAABjVlE8fgt8TlV2Xk75DOKAirPHmxhZbk5PsnSOl8uKrHSmt8vLmZl9wsWtMWHbcvrINjM9NbHEp6Z2bqeDRmCulVrREKjtNSMRyV38Pb1ReI6MoKQRPQUQO_4JYRXXssXJ145YNsyFbdDiFmugxAp3rv3PlVN7Qyts1ETOZ8colLD_vTs Oct 24 08:54:13.010655 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Id: None Oct 24 08:54:13.010655 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Name: None Oct 24 08:54:13.010655 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Identity-Status: Confirmed Oct 24 08:54:13.010655 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Is-Admin-Project: True Oct 24 08:54:13.010655 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Id: default Oct 24 08:54:13.010655 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Name: Default Oct 24 08:54:13.010655 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Id: f063c719bcda47e6874437d32d284815 Oct 24 08:54:13.010655 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-577585278 Oct 24 08:54:13.010655 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Role: reader,member Oct 24 08:54:13.010655 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Roles: reader,member Oct 24 08:54:13.012084 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f063c719bcda47e6874437d32d284815", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f063c719bcda47e6874437d32d284815"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f063c719bcda47e6874437d32d284815"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f063c719bcda47e6874437d32d284815"}]}] Oct 24 08:54:13.012084 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant: tempest-ServerRescueNegativeTestJSON-577585278 Oct 24 08:54:13.012084 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Id: f063c719bcda47e6874437d32d284815 Oct 24 08:54:13.012084 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-577585278 Oct 24 08:54:13.012084 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User: tempest-ServerRescueNegativeTestJSON-577585278-project Oct 24 08:54:13.012084 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Id: default Oct 24 08:54:13.012084 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Name: Default Oct 24 08:54:13.012084 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Id: 8695364e58b04d829b12ae1b49757536 Oct 24 08:54:13.012084 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Name: tempest-ServerRescueNegativeTestJSON-577585278-project Oct 24 08:54:13.012084 dv-cinder-master-3-smb devstack@n-api.service[125165]: method: > Oct 24 08:54:13.012084 dv-cinder-master-3-smb devstack@n-api.service[125165]: exception: Instance f2772d7f-d505-44ab-a062-58bd88bd49d3 could not be found. Oct 24 08:54:13.012084 dv-cinder-master-3-smb devstack@n-api.service[125165]: action_args: {'id': 'f2772d7f-d505-44ab-a062-58bd88bd49d3'} Oct 24 08:54:13.012973 dv-cinder-master-3-smb devstack@n-api.service[125165]: {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:54:13.012973 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:13.012973 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:54:13.012973 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:54:13.012973 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:54:13.012973 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:54:13.012973 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:54:13.012973 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:54:13.012973 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:54:13.012973 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:54:13.012973 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2772d7f-d505-44ab-a062-58bd88bd49d3 could not be found. Oct 24 08:54:13.012973 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:54:13.012973 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:54:13.012973 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:54:13.012973 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:13.012973 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:54:13.012973 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:54:13.012973 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:54:13.012973 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:54:13.012973 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:54:13.014480 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:54:13.014480 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:54:13.014480 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:54:13.014480 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:54:13.014480 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:54:13.014480 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:54:13.014480 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:54:13.014480 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2772d7f-d505-44ab-a062-58bd88bd49d3 could not be found. Oct 24 08:54:13.014480 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:54:13.014480 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:54:13.014480 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:54:13.014480 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:13.014480 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:54:13.014480 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:54:13.014480 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:54:13.014480 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:54:13.014480 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2772d7f-d505-44ab-a062-58bd88bd49d3 could not be found. Oct 24 08:54:13.014480 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:54:13.015927 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-f32da85c-78a6-40f7-8da0-ec720f68000e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] Returning 404 to user: Instance f2772d7f-d505-44ab-a062-58bd88bd49d3 could not be found. {{(pid=125165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:54:13.015927 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-f32da85c-78a6-40f7-8da0-ec720f68000e tempest-ServerRescueNegativeTestJSON-577585278 tempest-ServerRescueNegativeTestJSON-577585278-project] 10.222.0.26 "GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3" status: 404 len: 111 microversion: 2.1 time: 0.030574 Oct 24 08:54:13.015927 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 361/722] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:12 2022] GET /compute/v2.1/servers/f2772d7f-d505-44ab-a062-58bd88bd49d3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:54:17.785230 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-b6d694ad-66f0-4fef-b963-fec6b39310a2 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:17.785806 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-b6d694ad-66f0-4fef-b963-fec6b39310a2 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 9ba684f7-ce77-465c-a6d7-7840517ef487] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:17.792843 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b6d694ad-66f0-4fef-b963-fec6b39310a2 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:17.793332 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b6d694ad-66f0-4fef-b963-fec6b39310a2 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:17.793766 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b6d694ad-66f0-4fef-b963-fec6b39310a2 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:17.794460 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b6d694ad-66f0-4fef-b963-fec6b39310a2 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:17.794939 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b6d694ad-66f0-4fef-b963-fec6b39310a2 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:17.795365 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b6d694ad-66f0-4fef-b963-fec6b39310a2 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:17.799556 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:17.819554 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-b6d694ad-66f0-4fef-b963-fec6b39310a2 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487/ips" status: 200 len: 150 microversion: 2.1 time: 0.038335 Oct 24 08:54:17.820130 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 362/723] 10.222.0.26 () {58 vars in 1248 bytes} [Mon Oct 24 08:54:17 2022] GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:54:19.173728 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-b089869c-8b83-4d04-936c-24a884372ddf tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27572c4f-9d81-4954-bc27-b05fe6c130ce"}} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:19.176238 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-b089869c-8b83-4d04-936c-24a884372ddf tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 9ba684f7-ce77-465c-a6d7-7840517ef487] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:19.182695 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b089869c-8b83-4d04-936c-24a884372ddf tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:19.183146 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b089869c-8b83-4d04-936c-24a884372ddf tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:19.183580 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b089869c-8b83-4d04-936c-24a884372ddf tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:19.184265 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b089869c-8b83-4d04-936c-24a884372ddf tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:19.184716 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b089869c-8b83-4d04-936c-24a884372ddf tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:19.185134 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b089869c-8b83-4d04-936c-24a884372ddf tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:19.486549 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-b089869c-8b83-4d04-936c-24a884372ddf tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "POST /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.317151 Oct 24 08:54:19.487260 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 362/724] 10.222.0.26 () {60 vars in 1323 bytes} [Mon Oct 24 08:54:19 2022] POST /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487/os-volume_attachments => generated 194 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:54:21.762460 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-2f260f5f-c9ec-41f8-af4c-7b7e67e06bd1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27572c4f-9d81-4954-bc27-b05fe6c130ce"}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:21.764852 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-2f260f5f-c9ec-41f8-af4c-7b7e67e06bd1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 9ba684f7-ce77-465c-a6d7-7840517ef487] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:21.772656 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2f260f5f-c9ec-41f8-af4c-7b7e67e06bd1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:21.773134 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2f260f5f-c9ec-41f8-af4c-7b7e67e06bd1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:21.773568 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2f260f5f-c9ec-41f8-af4c-7b7e67e06bd1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:21.774254 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2f260f5f-c9ec-41f8-af4c-7b7e67e06bd1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:21.774707 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2f260f5f-c9ec-41f8-af4c-7b7e67e06bd1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:21.775146 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2f260f5f-c9ec-41f8-af4c-7b7e67e06bd1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:21.854522 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.wsgi [None req-2f260f5f-c9ec-41f8-af4c-7b7e67e06bd1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] HTTP exception thrown: Invalid volume: volume 27572c4f-9d81-4954-bc27-b05fe6c130ce is already attached to instances: 9ba684f7-ce77-465c-a6d7-7840517ef487 Oct 24 08:54:21.856213 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-2f260f5f-c9ec-41f8-af4c-7b7e67e06bd1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Request method failure captured: Oct 24 08:54:21.856213 dv-cinder-master-3-smb devstack@n-api.service[125164]: request: POST /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487/os-volume_attachments HTTP/1.1 Oct 24 08:54:21.856213 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept: application/json Oct 24 08:54:21.856213 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept-Encoding: identity Oct 24 08:54:21.856213 dv-cinder-master-3-smb devstack@n-api.service[125164]: Connection: close Oct 24 08:54:21.856213 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Length: 74 Oct 24 08:54:21.856213 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Type: application/json Oct 24 08:54:21.856213 dv-cinder-master-3-smb devstack@n-api.service[125164]: Host: 10.222.0.26 Oct 24 08:54:21.856213 dv-cinder-master-3-smb devstack@n-api.service[125164]: Openstack-System-Scope: None Oct 24 08:54:21.856213 dv-cinder-master-3-smb devstack@n-api.service[125164]: User-Agent: python-urllib3/1.26.12 Oct 24 08:54:21.856213 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Auth-Token: gAAAAABjVlE2u8htP-0ukfebxjPQ_Tv08AEgRkqfcKErVq7KuTRTMT0ulC9K9eGWmc0J9Q6UTd3t0f_FhG9s34JNa-sHLE0_eBaC2GRhGdxZJM_viMU6wO-8X3T5-_M7hKYRa28fguCQkp2kM0S7f5w35MMqRh0sMsrU0PYXCVdXzPLgYLOBkKQ Oct 24 08:54:21.856213 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Id: None Oct 24 08:54:21.856213 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Name: None Oct 24 08:54:21.856213 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Identity-Status: Confirmed Oct 24 08:54:21.856213 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Is-Admin-Project: True Oct 24 08:54:21.856213 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Id: default Oct 24 08:54:21.856213 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Name: Default Oct 24 08:54:21.856213 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Id: 02be1b30677f400788b35b03938e44e5 Oct 24 08:54:21.856213 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Name: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:54:21.856213 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Role: reader,member Oct 24 08:54:21.856213 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Roles: reader,member Oct 24 08:54:21.857793 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_02be1b30677f400788b35b03938e44e5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/02be1b30677f400788b35b03938e44e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02be1b30677f400788b35b03938e44e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02be1b30677f400788b35b03938e44e5"}]}] Oct 24 08:54:21.857793 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:54:21.857793 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Id: 02be1b30677f400788b35b03938e44e5 Oct 24 08:54:21.857793 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:54:21.857793 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User: tempest-AttachVolumeNegativeTest-1868225476-project Oct 24 08:54:21.857793 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Id: default Oct 24 08:54:21.857793 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Name: Default Oct 24 08:54:21.857793 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Id: 712e5cf4cc004918817ab1802b9c69d6 Oct 24 08:54:21.857793 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Name: tempest-AttachVolumeNegativeTest-1868225476-project Oct 24 08:54:21.857793 dv-cinder-master-3-smb devstack@n-api.service[125164]: Oct 24 08:54:21.857793 dv-cinder-master-3-smb devstack@n-api.service[125164]: {"volumeAttachment": {"volumeId": "27572c4f-9d81-4954-bc27-b05fe6c130ce"}} Oct 24 08:54:21.857793 dv-cinder-master-3-smb devstack@n-api.service[125164]: method: > Oct 24 08:54:21.858652 dv-cinder-master-3-smb devstack@n-api.service[125164]: exception: Invalid volume: volume 27572c4f-9d81-4954-bc27-b05fe6c130ce is already attached to instances: 9ba684f7-ce77-465c-a6d7-7840517ef487 Oct 24 08:54:21.858652 dv-cinder-master-3-smb devstack@n-api.service[125164]: action_args: {'server_id': '9ba684f7-ce77-465c-a6d7-7840517ef487', 'body': {'volumeAttachment': {'volumeId': '27572c4f-9d81-4954-bc27-b05fe6c130ce'}}} Oct 24 08:54:21.858652 dv-cinder-master-3-smb devstack@n-api.service[125164]: {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:54:21.858652 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:21.858652 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 24 08:54:21.858652 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 24 08:54:21.858652 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 08:54:21.858652 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 08:54:21.858652 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 24 08:54:21.858652 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 08:54:21.858652 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 24 08:54:21.858652 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 24 08:54:21.858652 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 24 08:54:21.858652 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 24 08:54:21.858652 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 27572c4f-9d81-4954-bc27-b05fe6c130ce is already attached to instances: 9ba684f7-ce77-465c-a6d7-7840517ef487 Oct 24 08:54:21.858652 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:54:21.858652 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:54:21.858652 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:54:21.858652 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:21.860098 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:54:21.860098 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:54:21.860098 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:54:21.860098 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:54:21.860098 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:54:21.860098 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:54:21.860098 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:54:21.860098 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:54:21.860098 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:54:21.860098 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:54:21.860098 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 08:54:21.860098 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 08:54:21.860098 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 24 08:54:21.860098 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 24 08:54:21.860098 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 27572c4f-9d81-4954-bc27-b05fe6c130ce is already attached to instances: 9ba684f7-ce77-465c-a6d7-7840517ef487 Oct 24 08:54:21.860098 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:54:21.860098 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:54:21.860098 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:54:21.860098 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:21.860098 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:54:21.861996 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:54:21.861996 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:54:21.861996 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:54:21.861996 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 27572c4f-9d81-4954-bc27-b05fe6c130ce is already attached to instances: 9ba684f7-ce77-465c-a6d7-7840517ef487 Oct 24 08:54:21.861996 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:54:21.861996 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-2f260f5f-c9ec-41f8-af4c-7b7e67e06bd1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Returning 400 to user: Invalid volume: volume 27572c4f-9d81-4954-bc27-b05fe6c130ce is already attached to instances: 9ba684f7-ce77-465c-a6d7-7840517ef487 {{(pid=125164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:54:21.861996 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-2f260f5f-c9ec-41f8-af4c-7b7e67e06bd1 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "POST /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099303 Oct 24 08:54:21.861996 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 363/725] 10.222.0.26 () {60 vars in 1323 bytes} [Mon Oct 24 08:54:21 2022] POST /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 08:54:21.926886 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-568623b8-bf56-41a2-b40d-9843d5518646 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:21.927470 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-568623b8-bf56-41a2-b40d-9843d5518646 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 9ba684f7-ce77-465c-a6d7-7840517ef487] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:21.933734 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-568623b8-bf56-41a2-b40d-9843d5518646 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:21.934248 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-568623b8-bf56-41a2-b40d-9843d5518646 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:21.934689 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-568623b8-bf56-41a2-b40d-9843d5518646 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:21.935414 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-568623b8-bf56-41a2-b40d-9843d5518646 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:21.935871 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-568623b8-bf56-41a2-b40d-9843d5518646 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:21.936295 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-568623b8-bf56-41a2-b40d-9843d5518646 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:22.026151 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.objects.instance [None req-568623b8-bf56-41a2-b40d-9843d5518646 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lazy-loading 'services' on Instance uuid 9ba684f7-ce77-465c-a6d7-7840517ef487 {{(pid=125165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:54:22.103812 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-568623b8-bf56-41a2-b40d-9843d5518646 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487/os-volume_attachments/27572c4f-9d81-4954-bc27-b05fe6c130ce" status: 202 len: 0 microversion: 2.1 time: 0.184455 Oct 24 08:54:22.104593 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 363/726] 10.222.0.26 () {58 vars in 1416 bytes} [Mon Oct 24 08:54:21 2022] DELETE /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487/os-volume_attachments/27572c4f-9d81-4954-bc27-b05fe6c130ce => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:54:22.113104 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-1210faf7-93d2-45a4-9599-461d7f7fcfa4 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:22.115434 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-1210faf7-93d2-45a4-9599-461d7f7fcfa4 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 9ba684f7-ce77-465c-a6d7-7840517ef487] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:22.121630 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1210faf7-93d2-45a4-9599-461d7f7fcfa4 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:22.122142 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1210faf7-93d2-45a4-9599-461d7f7fcfa4 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:22.122569 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1210faf7-93d2-45a4-9599-461d7f7fcfa4 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:22.123299 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1210faf7-93d2-45a4-9599-461d7f7fcfa4 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:22.123758 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1210faf7-93d2-45a4-9599-461d7f7fcfa4 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:22.124204 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1210faf7-93d2-45a4-9599-461d7f7fcfa4 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:22.154994 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-1210faf7-93d2-45a4-9599-461d7f7fcfa4 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045714 Oct 24 08:54:22.155472 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 364/727] 10.222.0.26 () {58 vars in 1302 bytes} [Mon Oct 24 08:54:22 2022] GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:54:23.168261 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-6d166548-6837-49f6-9217-0fdb6eddbb90 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:23.171528 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-6d166548-6837-49f6-9217-0fdb6eddbb90 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 9ba684f7-ce77-465c-a6d7-7840517ef487] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:23.179819 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6d166548-6837-49f6-9217-0fdb6eddbb90 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:23.180299 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6d166548-6837-49f6-9217-0fdb6eddbb90 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:23.180726 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6d166548-6837-49f6-9217-0fdb6eddbb90 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:23.181461 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6d166548-6837-49f6-9217-0fdb6eddbb90 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:23.181853 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6d166548-6837-49f6-9217-0fdb6eddbb90 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:23.182269 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6d166548-6837-49f6-9217-0fdb6eddbb90 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:23.212876 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-6d166548-6837-49f6-9217-0fdb6eddbb90 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049438 Oct 24 08:54:23.213449 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 364/728] 10.222.0.26 () {58 vars in 1302 bytes} [Mon Oct 24 08:54:23 2022] GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:54:23.279940 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-dc8f1d7a-f916-4885-b027-05261f997311 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:23.280512 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-dc8f1d7a-f916-4885-b027-05261f997311 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 9ba684f7-ce77-465c-a6d7-7840517ef487] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:23.287260 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-dc8f1d7a-f916-4885-b027-05261f997311 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:23.287798 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-dc8f1d7a-f916-4885-b027-05261f997311 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:23.288236 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-dc8f1d7a-f916-4885-b027-05261f997311 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:23.288929 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-dc8f1d7a-f916-4885-b027-05261f997311 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:23.289420 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-dc8f1d7a-f916-4885-b027-05261f997311 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:23.289852 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-dc8f1d7a-f916-4885-b027-05261f997311 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:23.316064 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-dc8f1d7a-f916-4885-b027-05261f997311 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 9ba684f7-ce77-465c-a6d7-7840517ef487] Going to try to terminate instance {{(pid=125164) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:54:23.397529 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-dc8f1d7a-f916-4885-b027-05261f997311 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487" status: 204 len: 0 microversion: 2.1 time: 0.121135 Oct 24 08:54:23.397978 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 365/729] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Oct 24 08:54:23 2022] DELETE /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:54:23.406274 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-c306373e-6d78-463a-a447-e8eb27f1c4bb tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:23.406928 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-c306373e-6d78-463a-a447-e8eb27f1c4bb tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 9ba684f7-ce77-465c-a6d7-7840517ef487] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:23.412938 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c306373e-6d78-463a-a447-e8eb27f1c4bb tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:23.413416 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c306373e-6d78-463a-a447-e8eb27f1c4bb tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:23.413851 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c306373e-6d78-463a-a447-e8eb27f1c4bb tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:23.414535 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c306373e-6d78-463a-a447-e8eb27f1c4bb tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:23.415015 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c306373e-6d78-463a-a447-e8eb27f1c4bb tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:23.415439 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c306373e-6d78-463a-a447-e8eb27f1c4bb tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:23.548464 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-c306373e-6d78-463a-a447-e8eb27f1c4bb tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:23.556468 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-c306373e-6d78-463a-a447-e8eb27f1c4bb tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487" status: 200 len: 1682 microversion: 2.1 time: 0.154118 Oct 24 08:54:23.557033 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 365/730] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:23 2022] GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:24.585265 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-8c645570-2fc7-42b1-b001-5d5f40f1acb6 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:24.586420 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-8c645570-2fc7-42b1-b001-5d5f40f1acb6 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 9ba684f7-ce77-465c-a6d7-7840517ef487] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:24.596877 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8c645570-2fc7-42b1-b001-5d5f40f1acb6 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:24.597398 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8c645570-2fc7-42b1-b001-5d5f40f1acb6 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:24.597838 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8c645570-2fc7-42b1-b001-5d5f40f1acb6 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:24.598528 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8c645570-2fc7-42b1-b001-5d5f40f1acb6 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:24.599011 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8c645570-2fc7-42b1-b001-5d5f40f1acb6 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:24.599433 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8c645570-2fc7-42b1-b001-5d5f40f1acb6 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:24.741537 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-8c645570-2fc7-42b1-b001-5d5f40f1acb6 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:24.749594 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-8c645570-2fc7-42b1-b001-5d5f40f1acb6 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487" status: 200 len: 1682 microversion: 2.1 time: 0.171616 Oct 24 08:54:24.750141 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 366/731] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:24 2022] GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487 => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:25.775017 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-7fc4b0e6-192a-4ca8-ba34-be02fbdbf352 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:25.776334 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-7fc4b0e6-192a-4ca8-ba34-be02fbdbf352 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 9ba684f7-ce77-465c-a6d7-7840517ef487] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:25.783253 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:25.785595 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7fc4b0e6-192a-4ca8-ba34-be02fbdbf352 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:25.786691 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7fc4b0e6-192a-4ca8-ba34-be02fbdbf352 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:25.787457 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7fc4b0e6-192a-4ca8-ba34-be02fbdbf352 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:25.788681 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7fc4b0e6-192a-4ca8-ba34-be02fbdbf352 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:25.789276 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7fc4b0e6-192a-4ca8-ba34-be02fbdbf352 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:25.789996 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7fc4b0e6-192a-4ca8-ba34-be02fbdbf352 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:25.979127 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-7fc4b0e6-192a-4ca8-ba34-be02fbdbf352 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:25.988037 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-7fc4b0e6-192a-4ca8-ba34-be02fbdbf352 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487" status: 200 len: 1682 microversion: 2.1 time: 0.216700 Oct 24 08:54:25.988992 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 366/732] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:25 2022] GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487 => generated 1682 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:26.184039 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-4768cd32-5a2a-4ba1-93a4-e021f5356ff6 req-d30f5bc0-fc50-4bb5-8e1a-c983716409c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ba684f7-ce77-465c-a6d7-7840517ef487", "name": "network-vif-deleted", "tag": "1419fed7-a1ba-40a7-8adf-a4288addb6bf"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:26.190610 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:26.196922 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-4768cd32-5a2a-4ba1-93a4-e021f5356ff6 req-d30f5bc0-fc50-4bb5-8e1a-c983716409c2 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:26.197399 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-4768cd32-5a2a-4ba1-93a4-e021f5356ff6 req-d30f5bc0-fc50-4bb5-8e1a-c983716409c2 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:26.197829 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-4768cd32-5a2a-4ba1-93a4-e021f5356ff6 req-d30f5bc0-fc50-4bb5-8e1a-c983716409c2 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:26.212466 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-4768cd32-5a2a-4ba1-93a4-e021f5356ff6 req-d30f5bc0-fc50-4bb5-8e1a-c983716409c2 service nova] Creating event network-vif-deleted:1419fed7-a1ba-40a7-8adf-a4288addb6bf for instance 9ba684f7-ce77-465c-a6d7-7840517ef487 on hv-cinder-maste Oct 24 08:54:26.218898 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-4768cd32-5a2a-4ba1-93a4-e021f5356ff6 req-d30f5bc0-fc50-4bb5-8e1a-c983716409c2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038849 Oct 24 08:54:26.219670 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 367/733] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:54:27.011763 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-0baf9ecb-1c29-4bce-986c-bd4453265646 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:27.012496 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-0baf9ecb-1c29-4bce-986c-bd4453265646 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 9ba684f7-ce77-465c-a6d7-7840517ef487] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:27.019169 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0baf9ecb-1c29-4bce-986c-bd4453265646 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:27.019648 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0baf9ecb-1c29-4bce-986c-bd4453265646 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:27.020075 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0baf9ecb-1c29-4bce-986c-bd4453265646 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:27.020755 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0baf9ecb-1c29-4bce-986c-bd4453265646 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:27.021195 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0baf9ecb-1c29-4bce-986c-bd4453265646 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:27.021616 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0baf9ecb-1c29-4bce-986c-bd4453265646 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:27.035755 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.wsgi [None req-0baf9ecb-1c29-4bce-986c-bd4453265646 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] HTTP exception thrown: Instance 9ba684f7-ce77-465c-a6d7-7840517ef487 could not be found. Oct 24 08:54:27.037430 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-0baf9ecb-1c29-4bce-986c-bd4453265646 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Request method failure captured: Oct 24 08:54:27.037430 dv-cinder-master-3-smb devstack@n-api.service[125165]: request: GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487 HTTP/1.1 Oct 24 08:54:27.037430 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept: application/json Oct 24 08:54:27.037430 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept-Encoding: identity Oct 24 08:54:27.037430 dv-cinder-master-3-smb devstack@n-api.service[125165]: Connection: close Oct 24 08:54:27.037430 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Length: 0 Oct 24 08:54:27.037430 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Type: application/json Oct 24 08:54:27.037430 dv-cinder-master-3-smb devstack@n-api.service[125165]: Host: 10.222.0.26 Oct 24 08:54:27.037430 dv-cinder-master-3-smb devstack@n-api.service[125165]: Openstack-System-Scope: None Oct 24 08:54:27.037430 dv-cinder-master-3-smb devstack@n-api.service[125165]: User-Agent: python-urllib3/1.26.12 Oct 24 08:54:27.037430 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Auth-Token: gAAAAABjVlE2u8htP-0ukfebxjPQ_Tv08AEgRkqfcKErVq7KuTRTMT0ulC9K9eGWmc0J9Q6UTd3t0f_FhG9s34JNa-sHLE0_eBaC2GRhGdxZJM_viMU6wO-8X3T5-_M7hKYRa28fguCQkp2kM0S7f5w35MMqRh0sMsrU0PYXCVdXzPLgYLOBkKQ Oct 24 08:54:27.037430 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Id: None Oct 24 08:54:27.037430 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Name: None Oct 24 08:54:27.037430 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Identity-Status: Confirmed Oct 24 08:54:27.037430 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Is-Admin-Project: True Oct 24 08:54:27.037430 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Id: default Oct 24 08:54:27.037430 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Name: Default Oct 24 08:54:27.037430 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Id: 02be1b30677f400788b35b03938e44e5 Oct 24 08:54:27.037430 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Name: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:54:27.037430 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Role: reader,member Oct 24 08:54:27.037430 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Roles: reader,member Oct 24 08:54:27.039153 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_02be1b30677f400788b35b03938e44e5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/02be1b30677f400788b35b03938e44e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02be1b30677f400788b35b03938e44e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02be1b30677f400788b35b03938e44e5"}]}] Oct 24 08:54:27.039153 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:54:27.039153 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Id: 02be1b30677f400788b35b03938e44e5 Oct 24 08:54:27.039153 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:54:27.039153 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User: tempest-AttachVolumeNegativeTest-1868225476-project Oct 24 08:54:27.039153 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Id: default Oct 24 08:54:27.039153 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Name: Default Oct 24 08:54:27.039153 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Id: 712e5cf4cc004918817ab1802b9c69d6 Oct 24 08:54:27.039153 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Name: tempest-AttachVolumeNegativeTest-1868225476-project Oct 24 08:54:27.039153 dv-cinder-master-3-smb devstack@n-api.service[125165]: method: > Oct 24 08:54:27.039153 dv-cinder-master-3-smb devstack@n-api.service[125165]: exception: Instance 9ba684f7-ce77-465c-a6d7-7840517ef487 could not be found. Oct 24 08:54:27.039153 dv-cinder-master-3-smb devstack@n-api.service[125165]: action_args: {'id': '9ba684f7-ce77-465c-a6d7-7840517ef487'} Oct 24 08:54:27.040967 dv-cinder-master-3-smb devstack@n-api.service[125165]: {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:54:27.040967 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:27.040967 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:54:27.040967 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:54:27.040967 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:54:27.040967 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:54:27.040967 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:54:27.040967 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:54:27.040967 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:54:27.040967 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:54:27.040967 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ba684f7-ce77-465c-a6d7-7840517ef487 could not be found. Oct 24 08:54:27.040967 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:54:27.040967 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:54:27.040967 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:54:27.040967 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:27.040967 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:54:27.040967 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:54:27.040967 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:54:27.040967 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:54:27.040967 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:54:27.042608 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:54:27.042608 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:54:27.042608 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:54:27.042608 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:54:27.042608 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:54:27.042608 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:54:27.042608 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:54:27.042608 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ba684f7-ce77-465c-a6d7-7840517ef487 could not be found. Oct 24 08:54:27.042608 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:54:27.042608 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:54:27.042608 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:54:27.042608 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:27.042608 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:54:27.042608 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:54:27.042608 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:54:27.042608 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:54:27.042608 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ba684f7-ce77-465c-a6d7-7840517ef487 could not be found. Oct 24 08:54:27.042608 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:54:27.044272 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-0baf9ecb-1c29-4bce-986c-bd4453265646 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Returning 404 to user: Instance 9ba684f7-ce77-465c-a6d7-7840517ef487 could not be found. {{(pid=125165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:54:27.044272 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-0baf9ecb-1c29-4bce-986c-bd4453265646 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487" status: 404 len: 111 microversion: 2.1 time: 0.030956 Oct 24 08:54:27.044272 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 367/734] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:27 2022] GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:54:27.050496 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-2267eb78-9c1a-455c-a610-aa725611027f tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '.version_select at 0x7f7ef13c4550>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:27.072797 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-2267eb78-9c1a-455c-a610-aa725611027f tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2100768807" status: 202 len: 0 microversion: 2.1 time: 0.027784 Oct 24 08:54:27.073873 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 368/735] 10.222.0.26 () {58 vars in 1221 bytes} [Mon Oct 24 08:54:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2100768807 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:54:27.763249 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-d7afb17f-ce3b-4c72-a244-1560ca9824ed tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Action: 'create', calling method: .version_select at 0x7f7ef154db80>, body: {"keypair": {"name": "tempest-keypair-1059438653", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+pLHEQrIXGIvGNn0+5GkyzzfyIFIYf4C/OldLyDeiOJfoqW+e6megfbvpn3BVu4ChCG9pLh1g9bj8ECPgKRpeOzItUp31G7ru6hZcutgEBa8RrdrcuYm1UIzalpCGP3Q=="}} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:27.779140 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.quota [None req-d7afb17f-ce3b-4c72-a244-1560ca9824ed tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Getting quotas for project 02be1b30677f400788b35b03938e44e5. Resources: {'key_pairs'} {{(pid=125165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:54:27.783229 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.quota [None req-d7afb17f-ce3b-4c72-a244-1560ca9824ed tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Getting quotas for user 712e5cf4cc004918817ab1802b9c69d6 and project 02be1b30677f400788b35b03938e44e5. Resources: {'key_pairs'} {{(pid=125165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:54:27.806818 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-d7afb17f-ce3b-4c72-a244-1560ca9824ed tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047617 Oct 24 08:54:27.807578 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 368/736] 10.222.0.26 () {60 vars in 1159 bytes} [Mon Oct 24 08:54:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:54:29.122496 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-4bc88aae-526c-4f9b-93ae-53434d4eeeb4 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1900748886", "imageRef": "7eef2d62-12dc-4746-9cbd-870797d39b4d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "af0d0daa-6faa-4e0a-a58b-da03c7bc2818"}], "security_groups": [{"name": "tempest-securitygroup--985479867"}], "key_name": "tempest-keypair-1059438653", "user_data": "}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:29.236619 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.network.neutron [None req-4bc88aae-526c-4f9b-93ae-53434d4eeeb4 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] validate_networks() for [('af0d0daa-6faa-4e0a-a58b-da03c7bc2818', None, None, None, None, None)] {{(pid=125164) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:54:29.614529 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-4bc88aae-526c-4f9b-93ae-53434d4eeeb4 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Flavor limits 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:54:29.615012 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-4bc88aae-526c-4f9b-93ae-53434d4eeeb4 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Image limits 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:54:29.615488 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-4bc88aae-526c-4f9b-93ae-53434d4eeeb4 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Flavor pref 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:54:29.615899 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-4bc88aae-526c-4f9b-93ae-53434d4eeeb4 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Image pref 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:54:29.616312 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-4bc88aae-526c-4f9b-93ae-53434d4eeeb4 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:54:29.625243 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4bc88aae-526c-4f9b-93ae-53434d4eeeb4 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:29.625731 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4bc88aae-526c-4f9b-93ae-53434d4eeeb4 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:29.626166 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4bc88aae-526c-4f9b-93ae-53434d4eeeb4 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:29.626950 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4bc88aae-526c-4f9b-93ae-53434d4eeeb4 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:29.627405 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4bc88aae-526c-4f9b-93ae-53434d4eeeb4 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:29.627897 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4bc88aae-526c-4f9b-93ae-53434d4eeeb4 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:29.644781 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.quota [None req-4bc88aae-526c-4f9b-93ae-53434d4eeeb4 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Getting quotas for project 02be1b30677f400788b35b03938e44e5. Resources: {'ram', 'cores', 'instances'} {{(pid=125164) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:54:29.648911 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.quota [None req-4bc88aae-526c-4f9b-93ae-53434d4eeeb4 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Getting quotas for user 712e5cf4cc004918817ab1802b9c69d6 and project 02be1b30677f400788b35b03938e44e5. Resources: {'ram', 'cores', 'instances'} {{(pid=125164) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:54:29.661336 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-4bc88aae-526c-4f9b-93ae-53434d4eeeb4 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Going to run 1 instances... {{(pid=125164) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:54:29.663796 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-4bc88aae-526c-4f9b-93ae-53434d4eeeb4 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 83642ea6-d946-47b5-9d5a-e606cea14f3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7eef2d62-12dc-4746-9cbd-870797d39b4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125164) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:54:29.716622 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-4bc88aae-526c-4f9b-93ae-53434d4eeeb4 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.599011 Oct 24 08:54:29.717461 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 369/737] 10.222.0.26 () {60 vars in 1147 bytes} [Mon Oct 24 08:54:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:54:29.728953 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-cd452500-c7ff-4fd6-8310-653a2e68504f tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:29.729556 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-cd452500-c7ff-4fd6-8310-653a2e68504f tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 83642ea6-d946-47b5-9d5a-e606cea14f3e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:29.786798 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-cd452500-c7ff-4fd6-8310-653a2e68504f tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:29.796945 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-cd452500-c7ff-4fd6-8310-653a2e68504f tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e" status: 200 len: 1242 microversion: 2.1 time: 0.071714 Oct 24 08:54:29.797755 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 369/738] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:29 2022] GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:30.821294 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-6b4a5d58-1a3c-4c9b-96bb-d9175255d8fd tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:30.821845 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-6b4a5d58-1a3c-4c9b-96bb-d9175255d8fd tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 83642ea6-d946-47b5-9d5a-e606cea14f3e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:30.828130 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6b4a5d58-1a3c-4c9b-96bb-d9175255d8fd tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:30.828618 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6b4a5d58-1a3c-4c9b-96bb-d9175255d8fd tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:30.829057 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6b4a5d58-1a3c-4c9b-96bb-d9175255d8fd tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:30.829746 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6b4a5d58-1a3c-4c9b-96bb-d9175255d8fd tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:30.830203 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6b4a5d58-1a3c-4c9b-96bb-d9175255d8fd tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:30.830629 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6b4a5d58-1a3c-4c9b-96bb-d9175255d8fd tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:30.897031 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-6b4a5d58-1a3c-4c9b-96bb-d9175255d8fd tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:30.909636 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-6b4a5d58-1a3c-4c9b-96bb-d9175255d8fd tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e" status: 200 len: 1302 microversion: 2.1 time: 0.092867 Oct 24 08:54:30.911388 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 370/739] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:30 2022] GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e => generated 1302 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:31.934262 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-a23966dc-f001-4652-8248-c2969cf1badb tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:31.934836 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-a23966dc-f001-4652-8248-c2969cf1badb tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 83642ea6-d946-47b5-9d5a-e606cea14f3e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:31.941569 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a23966dc-f001-4652-8248-c2969cf1badb tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:31.942075 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a23966dc-f001-4652-8248-c2969cf1badb tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:31.942534 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a23966dc-f001-4652-8248-c2969cf1badb tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:31.943261 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a23966dc-f001-4652-8248-c2969cf1badb tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:31.943702 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a23966dc-f001-4652-8248-c2969cf1badb tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:31.944114 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a23966dc-f001-4652-8248-c2969cf1badb tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:32.082313 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a23966dc-f001-4652-8248-c2969cf1badb tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:32.090266 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-a23966dc-f001-4652-8248-c2969cf1badb tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e" status: 200 len: 1367 microversion: 2.1 time: 0.160024 Oct 24 08:54:32.090856 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 370/740] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:31 2022] GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:32.396709 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-42a8b17c-4cd0-439b-a415-af50cda1bb86 req-6e0ec50d-a426-416f-bf27-6d9dd24a95ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83642ea6-d946-47b5-9d5a-e606cea14f3e", "tag": "cf121c67-a47e-4ac2-91ae-60b1955ad16e"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:32.417222 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-42a8b17c-4cd0-439b-a415-af50cda1bb86 req-6e0ec50d-a426-416f-bf27-6d9dd24a95ae service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:32.417703 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-42a8b17c-4cd0-439b-a415-af50cda1bb86 req-6e0ec50d-a426-416f-bf27-6d9dd24a95ae service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:32.418316 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-42a8b17c-4cd0-439b-a415-af50cda1bb86 req-6e0ec50d-a426-416f-bf27-6d9dd24a95ae service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:32.430407 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-42a8b17c-4cd0-439b-a415-af50cda1bb86 req-6e0ec50d-a426-416f-bf27-6d9dd24a95ae service nova] Creating event network-changed:cf121c67-a47e-4ac2-91ae-60b1955ad16e for instance 83642ea6-d946-47b5-9d5a-e606cea14f3e on hv-cinder-maste Oct 24 08:54:32.435794 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-42a8b17c-4cd0-439b-a415-af50cda1bb86 req-6e0ec50d-a426-416f-bf27-6d9dd24a95ae service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042911 Oct 24 08:54:32.436426 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 371/741] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:54:33.118387 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-5cf8109a-c199-4511-8172-1b64c5a692e0 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:33.119364 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-5cf8109a-c199-4511-8172-1b64c5a692e0 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 83642ea6-d946-47b5-9d5a-e606cea14f3e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:33.130142 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5cf8109a-c199-4511-8172-1b64c5a692e0 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:33.131004 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5cf8109a-c199-4511-8172-1b64c5a692e0 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:33.131739 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5cf8109a-c199-4511-8172-1b64c5a692e0 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:33.132868 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5cf8109a-c199-4511-8172-1b64c5a692e0 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:33.133620 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5cf8109a-c199-4511-8172-1b64c5a692e0 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:33.134325 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5cf8109a-c199-4511-8172-1b64c5a692e0 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:33.270801 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-5cf8109a-c199-4511-8172-1b64c5a692e0 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:33.278586 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-5cf8109a-c199-4511-8172-1b64c5a692e0 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e" status: 200 len: 1367 microversion: 2.1 time: 0.166899 Oct 24 08:54:33.279273 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 371/742] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:33 2022] GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:34.303522 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-b4c2a998-0bbc-4c06-990f-fd99bfb81aa7 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:34.304221 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-b4c2a998-0bbc-4c06-990f-fd99bfb81aa7 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 83642ea6-d946-47b5-9d5a-e606cea14f3e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:34.311301 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b4c2a998-0bbc-4c06-990f-fd99bfb81aa7 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:34.312282 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b4c2a998-0bbc-4c06-990f-fd99bfb81aa7 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:34.313027 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b4c2a998-0bbc-4c06-990f-fd99bfb81aa7 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:34.314017 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b4c2a998-0bbc-4c06-990f-fd99bfb81aa7 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:34.314614 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b4c2a998-0bbc-4c06-990f-fd99bfb81aa7 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:34.315243 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b4c2a998-0bbc-4c06-990f-fd99bfb81aa7 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:34.462441 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-b4c2a998-0bbc-4c06-990f-fd99bfb81aa7 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:34.470068 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-b4c2a998-0bbc-4c06-990f-fd99bfb81aa7 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e" status: 200 len: 1367 microversion: 2.1 time: 0.171489 Oct 24 08:54:34.470628 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 372/743] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:34 2022] GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:35.492089 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-791c2a26-8450-427b-a65e-96b72a54400c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:35.493429 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-791c2a26-8450-427b-a65e-96b72a54400c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 83642ea6-d946-47b5-9d5a-e606cea14f3e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:35.500614 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-791c2a26-8450-427b-a65e-96b72a54400c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:35.501102 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-791c2a26-8450-427b-a65e-96b72a54400c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:35.501530 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-791c2a26-8450-427b-a65e-96b72a54400c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:35.502448 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-791c2a26-8450-427b-a65e-96b72a54400c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:35.502927 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-791c2a26-8450-427b-a65e-96b72a54400c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:35.503351 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-791c2a26-8450-427b-a65e-96b72a54400c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:35.634918 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-791c2a26-8450-427b-a65e-96b72a54400c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:35.642416 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-791c2a26-8450-427b-a65e-96b72a54400c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e" status: 200 len: 1367 microversion: 2.1 time: 0.154884 Oct 24 08:54:35.643052 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 372/744] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:35 2022] GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:36.669770 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-f4a52f7e-581e-4641-9ed3-1807b95f51e9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:36.671431 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-f4a52f7e-581e-4641-9ed3-1807b95f51e9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 83642ea6-d946-47b5-9d5a-e606cea14f3e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:36.678571 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f4a52f7e-581e-4641-9ed3-1807b95f51e9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:36.679333 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f4a52f7e-581e-4641-9ed3-1807b95f51e9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:36.679968 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f4a52f7e-581e-4641-9ed3-1807b95f51e9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:36.680717 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f4a52f7e-581e-4641-9ed3-1807b95f51e9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:36.681337 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f4a52f7e-581e-4641-9ed3-1807b95f51e9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:36.681972 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f4a52f7e-581e-4641-9ed3-1807b95f51e9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:36.824978 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-f4a52f7e-581e-4641-9ed3-1807b95f51e9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:36.833677 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-f4a52f7e-581e-4641-9ed3-1807b95f51e9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e" status: 200 len: 1367 microversion: 2.1 time: 0.172287 Oct 24 08:54:36.834253 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 373/745] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:36 2022] GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:37.743251 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-d54be055-fe37-40c2-a4cf-434b3190cae6 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-345491990", "imageRef": "7eef2d62-12dc-4746-9cbd-870797d39b4d", "flavorRef": "452", "networks": [{"uuid": "9ff6b12f-e1e8-4fca-9c1f-ae9eb6983610"}]}} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:37.795805 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.network.neutron [None req-d54be055-fe37-40c2-a4cf-434b3190cae6 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] validate_networks() for [('9ff6b12f-e1e8-4fca-9c1f-ae9eb6983610', None, None, None, None, None)] {{(pid=125165) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:54:37.856783 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-5ffa5a23-328f-4eb1-88e9-aa6f689c5045 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:37.857405 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-5ffa5a23-328f-4eb1-88e9-aa6f689c5045 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 83642ea6-d946-47b5-9d5a-e606cea14f3e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:37.864029 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5ffa5a23-328f-4eb1-88e9-aa6f689c5045 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:37.864515 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5ffa5a23-328f-4eb1-88e9-aa6f689c5045 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:37.864942 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5ffa5a23-328f-4eb1-88e9-aa6f689c5045 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:37.865630 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5ffa5a23-328f-4eb1-88e9-aa6f689c5045 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:37.866077 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5ffa5a23-328f-4eb1-88e9-aa6f689c5045 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:37.866493 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5ffa5a23-328f-4eb1-88e9-aa6f689c5045 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:38.064226 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-5ffa5a23-328f-4eb1-88e9-aa6f689c5045 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:38.072536 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-5ffa5a23-328f-4eb1-88e9-aa6f689c5045 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e" status: 200 len: 1367 microversion: 2.1 time: 0.219718 Oct 24 08:54:38.081182 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 374/746] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:37 2022] GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:38.134142 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-94df047c-2479-4686-94d3-c9ecc963f5d4 req-5dd23c94-2b18-45c1-93f5-f45f7303c482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83642ea6-d946-47b5-9d5a-e606cea14f3e", "name": "network-vif-plugged", "status": "completed", "tag": "cf121c67-a47e-4ac2-91ae-60b1955ad16e"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:38.144666 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-94df047c-2479-4686-94d3-c9ecc963f5d4 req-5dd23c94-2b18-45c1-93f5-f45f7303c482 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:38.145397 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-94df047c-2479-4686-94d3-c9ecc963f5d4 req-5dd23c94-2b18-45c1-93f5-f45f7303c482 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:38.145924 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-94df047c-2479-4686-94d3-c9ecc963f5d4 req-5dd23c94-2b18-45c1-93f5-f45f7303c482 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:38.157903 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-94df047c-2479-4686-94d3-c9ecc963f5d4 req-5dd23c94-2b18-45c1-93f5-f45f7303c482 service nova] Creating event network-vif-plugged:cf121c67-a47e-4ac2-91ae-60b1955ad16e for instance 83642ea6-d946-47b5-9d5a-e606cea14f3e on hv-cinder-maste Oct 24 08:54:38.163148 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-94df047c-2479-4686-94d3-c9ecc963f5d4 req-5dd23c94-2b18-45c1-93f5-f45f7303c482 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032700 Oct 24 08:54:38.163919 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 375/747] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:54:38.218313 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-d54be055-fe37-40c2-a4cf-434b3190cae6 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Flavor limits 0:0:0 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:54:38.218746 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-d54be055-fe37-40c2-a4cf-434b3190cae6 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Image limits 0:0:0 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:54:38.219220 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-d54be055-fe37-40c2-a4cf-434b3190cae6 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Flavor pref 0:0:0 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:54:38.219678 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-d54be055-fe37-40c2-a4cf-434b3190cae6 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Image pref 0:0:0 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:54:38.220052 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-d54be055-fe37-40c2-a4cf-434b3190cae6 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:54:38.228752 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d54be055-fe37-40c2-a4cf-434b3190cae6 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:38.229228 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d54be055-fe37-40c2-a4cf-434b3190cae6 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:38.229651 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d54be055-fe37-40c2-a4cf-434b3190cae6 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:38.230371 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d54be055-fe37-40c2-a4cf-434b3190cae6 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:38.230850 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d54be055-fe37-40c2-a4cf-434b3190cae6 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:38.231263 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d54be055-fe37-40c2-a4cf-434b3190cae6 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:38.247629 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.quota [None req-d54be055-fe37-40c2-a4cf-434b3190cae6 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Getting quotas for project 90625756dd824771a6221a0b919afe81. Resources: {'ram', 'cores', 'instances'} {{(pid=125165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:54:38.251776 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.quota [None req-d54be055-fe37-40c2-a4cf-434b3190cae6 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Getting quotas for user f4806783c2df4220b7bc37090ba2b40d and project 90625756dd824771a6221a0b919afe81. Resources: {'ram', 'cores', 'instances'} {{(pid=125165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:54:38.262913 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-d54be055-fe37-40c2-a4cf-434b3190cae6 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Going to run 1 instances... {{(pid=125165) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:54:38.265206 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-d54be055-fe37-40c2-a4cf-434b3190cae6 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] [instance: f4e45239-d466-49f2-841c-596152dddd18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7eef2d62-12dc-4746-9cbd-870797d39b4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125165) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:54:38.314491 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-d54be055-fe37-40c2-a4cf-434b3190cae6 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.687827 Oct 24 08:54:38.315144 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 373/748] 10.222.0.26 () {60 vars in 1147 bytes} [Mon Oct 24 08:54:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:54:38.327058 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-59ed85bc-1ddd-41eb-97eb-9938014f6380 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:38.327756 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-59ed85bc-1ddd-41eb-97eb-9938014f6380 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] [instance: f4e45239-d466-49f2-841c-596152dddd18] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:38.391209 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-59ed85bc-1ddd-41eb-97eb-9938014f6380 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4806783c2df4220b7bc37090ba2b40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90625756dd824771a6221a0b919afe81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:38.400556 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-59ed85bc-1ddd-41eb-97eb-9938014f6380 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] 10.222.0.26 "GET /compute/v2.1/servers/f4e45239-d466-49f2-841c-596152dddd18" status: 200 len: 1213 microversion: 2.1 time: 0.077616 Oct 24 08:54:38.401477 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 376/749] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:38 2022] GET /compute/v2.1/servers/f4e45239-d466-49f2-841c-596152dddd18 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:39.101113 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-1e57bd7f-4a59-4c93-b763-52dd381228c6 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:39.102122 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-1e57bd7f-4a59-4c93-b763-52dd381228c6 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 83642ea6-d946-47b5-9d5a-e606cea14f3e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:39.112331 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1e57bd7f-4a59-4c93-b763-52dd381228c6 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:39.113129 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1e57bd7f-4a59-4c93-b763-52dd381228c6 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:39.113858 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1e57bd7f-4a59-4c93-b763-52dd381228c6 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:39.114846 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1e57bd7f-4a59-4c93-b763-52dd381228c6 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:39.115295 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1e57bd7f-4a59-4c93-b763-52dd381228c6 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:39.115723 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1e57bd7f-4a59-4c93-b763-52dd381228c6 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:39.259712 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-1e57bd7f-4a59-4c93-b763-52dd381228c6 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:39.269398 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-1e57bd7f-4a59-4c93-b763-52dd381228c6 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e" status: 200 len: 1367 microversion: 2.1 time: 0.176172 Oct 24 08:54:39.269945 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 374/750] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:39 2022] GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:39.427881 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-bcfa1d2d-8fad-47db-8fde-5bbdf7d5b1e3 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:39.429009 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-bcfa1d2d-8fad-47db-8fde-5bbdf7d5b1e3 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] [instance: f4e45239-d466-49f2-841c-596152dddd18] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:39.436496 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bcfa1d2d-8fad-47db-8fde-5bbdf7d5b1e3 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:39.436978 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bcfa1d2d-8fad-47db-8fde-5bbdf7d5b1e3 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:39.437416 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bcfa1d2d-8fad-47db-8fde-5bbdf7d5b1e3 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:39.438102 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bcfa1d2d-8fad-47db-8fde-5bbdf7d5b1e3 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:39.438554 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bcfa1d2d-8fad-47db-8fde-5bbdf7d5b1e3 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:39.439003 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bcfa1d2d-8fad-47db-8fde-5bbdf7d5b1e3 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:39.501168 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-bcfa1d2d-8fad-47db-8fde-5bbdf7d5b1e3 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4806783c2df4220b7bc37090ba2b40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90625756dd824771a6221a0b919afe81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:39.509016 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-bcfa1d2d-8fad-47db-8fde-5bbdf7d5b1e3 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] 10.222.0.26 "GET /compute/v2.1/servers/f4e45239-d466-49f2-841c-596152dddd18" status: 200 len: 1209 microversion: 2.1 time: 0.088217 Oct 24 08:54:39.509658 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 377/751] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:39 2022] GET /compute/v2.1/servers/f4e45239-d466-49f2-841c-596152dddd18 => generated 1209 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:40.293552 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-4eda789d-c991-453a-aaa2-7bcc1091b1b8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:40.294008 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-4eda789d-c991-453a-aaa2-7bcc1091b1b8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 83642ea6-d946-47b5-9d5a-e606cea14f3e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:40.301591 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4eda789d-c991-453a-aaa2-7bcc1091b1b8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:40.301994 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4eda789d-c991-453a-aaa2-7bcc1091b1b8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:40.304860 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4eda789d-c991-453a-aaa2-7bcc1091b1b8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:40.307230 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4eda789d-c991-453a-aaa2-7bcc1091b1b8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:40.307905 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4eda789d-c991-453a-aaa2-7bcc1091b1b8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:40.308750 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4eda789d-c991-453a-aaa2-7bcc1091b1b8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:40.311866 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:40.459179 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-4eda789d-c991-453a-aaa2-7bcc1091b1b8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:40.467443 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-4eda789d-c991-453a-aaa2-7bcc1091b1b8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e" status: 200 len: 1367 microversion: 2.1 time: 0.178845 Oct 24 08:54:40.468017 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 375/752] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:40 2022] GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:40.533244 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-96b6d096-e08c-4f53-be6c-f0047557cd6b tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:40.533799 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-96b6d096-e08c-4f53-be6c-f0047557cd6b tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] [instance: f4e45239-d466-49f2-841c-596152dddd18] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:40.535550 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell0:SELECT=2 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:40.541904 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-96b6d096-e08c-4f53-be6c-f0047557cd6b tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:40.542389 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-96b6d096-e08c-4f53-be6c-f0047557cd6b tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:40.542825 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-96b6d096-e08c-4f53-be6c-f0047557cd6b tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:40.543539 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-96b6d096-e08c-4f53-be6c-f0047557cd6b tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:40.544000 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-96b6d096-e08c-4f53-be6c-f0047557cd6b tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:40.544414 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-96b6d096-e08c-4f53-be6c-f0047557cd6b tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:40.610399 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-96b6d096-e08c-4f53-be6c-f0047557cd6b tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4806783c2df4220b7bc37090ba2b40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90625756dd824771a6221a0b919afe81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:40.618608 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-96b6d096-e08c-4f53-be6c-f0047557cd6b tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] 10.222.0.26 "GET /compute/v2.1/servers/f4e45239-d466-49f2-841c-596152dddd18" status: 200 len: 1265 microversion: 2.1 time: 0.089414 Oct 24 08:54:40.619230 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 378/753] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:40 2022] GET /compute/v2.1/servers/f4e45239-d466-49f2-841c-596152dddd18 => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:41.129095 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-55af15fa-1af9-47fc-bd6e-1d9bb6eee48b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:41.129590 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-55af15fa-1af9-47fc-bd6e-1d9bb6eee48b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:41.138418 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-55af15fa-1af9-47fc-bd6e-1d9bb6eee48b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:41.139331 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-55af15fa-1af9-47fc-bd6e-1d9bb6eee48b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:41.140179 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-55af15fa-1af9-47fc-bd6e-1d9bb6eee48b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:41.141228 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-55af15fa-1af9-47fc-bd6e-1d9bb6eee48b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:41.142910 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-55af15fa-1af9-47fc-bd6e-1d9bb6eee48b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:41.143480 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-55af15fa-1af9-47fc-bd6e-1d9bb6eee48b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:41.171891 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-55af15fa-1af9-47fc-bd6e-1d9bb6eee48b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c/ips" status: 200 len: 150 microversion: 2.20 time: 0.046777 Oct 24 08:54:41.173916 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 376/754] 10.222.0.26 () {60 vars in 1289 bytes} [Mon Oct 24 08:54:41 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c/ips => generated 150 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:54:41.490709 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-15b75546-6438-4970-9b12-761017dd48bc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:41.491971 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-15b75546-6438-4970-9b12-761017dd48bc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 83642ea6-d946-47b5-9d5a-e606cea14f3e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:41.498401 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-15b75546-6438-4970-9b12-761017dd48bc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:41.499205 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-15b75546-6438-4970-9b12-761017dd48bc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:41.499707 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-15b75546-6438-4970-9b12-761017dd48bc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:41.500403 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-15b75546-6438-4970-9b12-761017dd48bc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:41.500994 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-15b75546-6438-4970-9b12-761017dd48bc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:41.501700 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-15b75546-6438-4970-9b12-761017dd48bc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:41.639294 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-15b75546-6438-4970-9b12-761017dd48bc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:41.641360 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-45438145-04de-48d4-b2b8-dc64348201dd tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:41.642380 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-45438145-04de-48d4-b2b8-dc64348201dd tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] [instance: f4e45239-d466-49f2-841c-596152dddd18] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:41.648439 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-15b75546-6438-4970-9b12-761017dd48bc tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e" status: 200 len: 1558 microversion: 2.1 time: 0.161510 Oct 24 08:54:41.649383 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 379/755] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:41 2022] GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:41.649502 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-45438145-04de-48d4-b2b8-dc64348201dd tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:41.650067 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-45438145-04de-48d4-b2b8-dc64348201dd tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:41.650587 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-45438145-04de-48d4-b2b8-dc64348201dd tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:41.651353 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-45438145-04de-48d4-b2b8-dc64348201dd tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:41.652049 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-45438145-04de-48d4-b2b8-dc64348201dd tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:41.652477 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-45438145-04de-48d4-b2b8-dc64348201dd tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:41.672038 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-077d0241-4e01-485e-888c-111b76c0c4b6 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:41.672858 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-077d0241-4e01-485e-888c-111b76c0c4b6 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 83642ea6-d946-47b5-9d5a-e606cea14f3e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:41.679609 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-077d0241-4e01-485e-888c-111b76c0c4b6 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:41.680353 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-077d0241-4e01-485e-888c-111b76c0c4b6 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:41.680965 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-077d0241-4e01-485e-888c-111b76c0c4b6 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:41.681976 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-077d0241-4e01-485e-888c-111b76c0c4b6 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:41.682575 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-077d0241-4e01-485e-888c-111b76c0c4b6 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:41.683126 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-077d0241-4e01-485e-888c-111b76c0c4b6 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:41.720813 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-45438145-04de-48d4-b2b8-dc64348201dd tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4806783c2df4220b7bc37090ba2b40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90625756dd824771a6221a0b919afe81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:41.729306 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-45438145-04de-48d4-b2b8-dc64348201dd tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] 10.222.0.26 "GET /compute/v2.1/servers/f4e45239-d466-49f2-841c-596152dddd18" status: 200 len: 1271 microversion: 2.1 time: 0.091798 Oct 24 08:54:41.737051 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 377/756] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:41 2022] GET /compute/v2.1/servers/f4e45239-d466-49f2-841c-596152dddd18 => generated 1271 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:54:41.771738 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-077d0241-4e01-485e-888c-111b76c0c4b6 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104029 Oct 24 08:54:41.772340 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 380/757] 10.222.0.26 () {58 vars in 1275 bytes} [Mon Oct 24 08:54:41 2022] GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:54:42.707617 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-ab15023b-a51d-4288-8fb0-16fe272473f9 req-680fbb8f-b36f-4df3-8f54-1f509c651dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4e45239-d466-49f2-841c-596152dddd18", "tag": "ac075096-12ec-46bf-80a8-ccdf92322e2c"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:42.720038 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-ab15023b-a51d-4288-8fb0-16fe272473f9 req-680fbb8f-b36f-4df3-8f54-1f509c651dd2 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:42.720666 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-ab15023b-a51d-4288-8fb0-16fe272473f9 req-680fbb8f-b36f-4df3-8f54-1f509c651dd2 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:42.721623 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-ab15023b-a51d-4288-8fb0-16fe272473f9 req-680fbb8f-b36f-4df3-8f54-1f509c651dd2 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:42.734461 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-ab15023b-a51d-4288-8fb0-16fe272473f9 req-680fbb8f-b36f-4df3-8f54-1f509c651dd2 service nova] Creating event network-changed:ac075096-12ec-46bf-80a8-ccdf92322e2c for instance f4e45239-d466-49f2-841c-596152dddd18 on hv-cinder-maste Oct 24 08:54:42.740250 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-ab15023b-a51d-4288-8fb0-16fe272473f9 req-680fbb8f-b36f-4df3-8f54-1f509c651dd2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036658 Oct 24 08:54:42.740996 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 378/758] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:54:42.758151 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-d89cfec2-13e0-4f25-bee6-3876a9651de0 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:42.759970 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-d89cfec2-13e0-4f25-bee6-3876a9651de0 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] [instance: f4e45239-d466-49f2-841c-596152dddd18] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:42.768154 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d89cfec2-13e0-4f25-bee6-3876a9651de0 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:42.768648 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d89cfec2-13e0-4f25-bee6-3876a9651de0 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:42.769102 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d89cfec2-13e0-4f25-bee6-3876a9651de0 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:42.769822 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d89cfec2-13e0-4f25-bee6-3876a9651de0 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:42.770268 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d89cfec2-13e0-4f25-bee6-3876a9651de0 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:42.770684 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d89cfec2-13e0-4f25-bee6-3876a9651de0 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:42.968050 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-d89cfec2-13e0-4f25-bee6-3876a9651de0 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4806783c2df4220b7bc37090ba2b40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90625756dd824771a6221a0b919afe81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:42.976041 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-d89cfec2-13e0-4f25-bee6-3876a9651de0 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] 10.222.0.26 "GET /compute/v2.1/servers/f4e45239-d466-49f2-841c-596152dddd18" status: 200 len: 1313 microversion: 2.1 time: 0.227268 Oct 24 08:54:42.989088 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 381/759] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:42 2022] GET /compute/v2.1/servers/f4e45239-d466-49f2-841c-596152dddd18 => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:54:43.062487 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-fdfa816b-7c52-43fc-8f37-cc3ec7dcb245 req-934586a8-74a6-4b6f-85c1-fe0f2c3d3854 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83642ea6-d946-47b5-9d5a-e606cea14f3e", "tag": "cf121c67-a47e-4ac2-91ae-60b1955ad16e"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:43.072381 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-fdfa816b-7c52-43fc-8f37-cc3ec7dcb245 req-934586a8-74a6-4b6f-85c1-fe0f2c3d3854 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:43.073104 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-fdfa816b-7c52-43fc-8f37-cc3ec7dcb245 req-934586a8-74a6-4b6f-85c1-fe0f2c3d3854 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:43.073696 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-fdfa816b-7c52-43fc-8f37-cc3ec7dcb245 req-934586a8-74a6-4b6f-85c1-fe0f2c3d3854 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:43.084967 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-fdfa816b-7c52-43fc-8f37-cc3ec7dcb245 req-934586a8-74a6-4b6f-85c1-fe0f2c3d3854 service nova] Creating event network-changed:cf121c67-a47e-4ac2-91ae-60b1955ad16e for instance 83642ea6-d946-47b5-9d5a-e606cea14f3e on hv-cinder-maste Oct 24 08:54:43.089963 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-fdfa816b-7c52-43fc-8f37-cc3ec7dcb245 req-934586a8-74a6-4b6f-85c1-fe0f2c3d3854 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032232 Oct 24 08:54:43.090906 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 379/760] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:54:43.142600 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-9fc0fc49-245f-4361-b0fb-432856d55a30 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:43.143653 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-9fc0fc49-245f-4361-b0fb-432856d55a30 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:43.151942 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9fc0fc49-245f-4361-b0fb-432856d55a30 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:43.152997 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9fc0fc49-245f-4361-b0fb-432856d55a30 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:43.154192 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9fc0fc49-245f-4361-b0fb-432856d55a30 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:43.155925 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9fc0fc49-245f-4361-b0fb-432856d55a30 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:43.156588 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9fc0fc49-245f-4361-b0fb-432856d55a30 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:43.157264 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9fc0fc49-245f-4361-b0fb-432856d55a30 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:43.173510 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:43.186112 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.objects.instance [None req-9fc0fc49-245f-4361-b0fb-432856d55a30 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lazy-loading 'flavor' on Instance uuid aa2753cf-624f-4bf1-b85b-0fef0e35521c {{(pid=125164) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:54:43.391746 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-9fc0fc49-245f-4361-b0fb-432856d55a30 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "POST /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c/action" status: 202 len: 0 microversion: 2.20 time: 0.254678 Oct 24 08:54:43.392387 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 382/761] 10.222.0.26 () {62 vars in 1319 bytes} [Mon Oct 24 08:54:43 2022] POST /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:54:43.401181 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-d6148854-0410-4e45-9800-539ca5d368bc tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:43.401866 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-d6148854-0410-4e45-9800-539ca5d368bc tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:43.408792 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d6148854-0410-4e45-9800-539ca5d368bc tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:43.409286 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d6148854-0410-4e45-9800-539ca5d368bc tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:43.409744 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d6148854-0410-4e45-9800-539ca5d368bc tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:43.410437 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d6148854-0410-4e45-9800-539ca5d368bc tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:43.410919 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d6148854-0410-4e45-9800-539ca5d368bc tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:43.411336 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d6148854-0410-4e45-9800-539ca5d368bc tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:43.550756 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-d6148854-0410-4e45-9800-539ca5d368bc tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:43.559446 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-d6148854-0410-4e45-9800-539ca5d368bc tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:43.560861 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-d6148854-0410-4e45-9800-539ca5d368bc tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:43.562014 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-d6148854-0410-4e45-9800-539ca5d368bc tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1723 microversion: 2.20 time: 0.165201 Oct 24 08:54:43.562569 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 380/762] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:43 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:44.000261 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-04dcb620-5f0a-4e40-8876-4dab5c67bd2a tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:44.001072 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-04dcb620-5f0a-4e40-8876-4dab5c67bd2a tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] [instance: f4e45239-d466-49f2-841c-596152dddd18] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:44.008809 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-04dcb620-5f0a-4e40-8876-4dab5c67bd2a tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:44.009352 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-04dcb620-5f0a-4e40-8876-4dab5c67bd2a tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:44.009785 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-04dcb620-5f0a-4e40-8876-4dab5c67bd2a tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:44.010475 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-04dcb620-5f0a-4e40-8876-4dab5c67bd2a tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:44.010973 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-04dcb620-5f0a-4e40-8876-4dab5c67bd2a tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:44.011398 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-04dcb620-5f0a-4e40-8876-4dab5c67bd2a tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:44.149067 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-04dcb620-5f0a-4e40-8876-4dab5c67bd2a tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4806783c2df4220b7bc37090ba2b40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90625756dd824771a6221a0b919afe81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:44.157267 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-04dcb620-5f0a-4e40-8876-4dab5c67bd2a tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] 10.222.0.26 "GET /compute/v2.1/servers/f4e45239-d466-49f2-841c-596152dddd18" status: 200 len: 1313 microversion: 2.1 time: 0.162033 Oct 24 08:54:44.157839 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 383/763] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:43 2022] GET /compute/v2.1/servers/f4e45239-d466-49f2-841c-596152dddd18 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:44.591303 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-0985cb62-7365-4408-a948-1b602dbd3ad6 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:44.592187 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-0985cb62-7365-4408-a948-1b602dbd3ad6 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:44.603319 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0985cb62-7365-4408-a948-1b602dbd3ad6 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:44.604127 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0985cb62-7365-4408-a948-1b602dbd3ad6 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:44.604839 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0985cb62-7365-4408-a948-1b602dbd3ad6 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:44.606003 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0985cb62-7365-4408-a948-1b602dbd3ad6 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:44.606806 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0985cb62-7365-4408-a948-1b602dbd3ad6 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:44.607501 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0985cb62-7365-4408-a948-1b602dbd3ad6 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:44.749252 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-0985cb62-7365-4408-a948-1b602dbd3ad6 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:44.757964 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-0985cb62-7365-4408-a948-1b602dbd3ad6 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:44.759451 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-0985cb62-7365-4408-a948-1b602dbd3ad6 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:44.760602 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-0985cb62-7365-4408-a948-1b602dbd3ad6 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1723 microversion: 2.20 time: 0.176184 Oct 24 08:54:44.761165 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 381/764] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:44 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:45.180932 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-bee7f17a-b1a9-4f33-9287-f67847c3acd7 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:45.181493 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-bee7f17a-b1a9-4f33-9287-f67847c3acd7 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] [instance: f4e45239-d466-49f2-841c-596152dddd18] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:45.188510 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bee7f17a-b1a9-4f33-9287-f67847c3acd7 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:45.188994 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bee7f17a-b1a9-4f33-9287-f67847c3acd7 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:45.189424 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bee7f17a-b1a9-4f33-9287-f67847c3acd7 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:45.190230 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bee7f17a-b1a9-4f33-9287-f67847c3acd7 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:45.190687 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bee7f17a-b1a9-4f33-9287-f67847c3acd7 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:45.191135 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bee7f17a-b1a9-4f33-9287-f67847c3acd7 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:45.328259 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-bee7f17a-b1a9-4f33-9287-f67847c3acd7 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4806783c2df4220b7bc37090ba2b40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90625756dd824771a6221a0b919afe81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:45.338435 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-bee7f17a-b1a9-4f33-9287-f67847c3acd7 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] 10.222.0.26 "GET /compute/v2.1/servers/f4e45239-d466-49f2-841c-596152dddd18" status: 200 len: 1313 microversion: 2.1 time: 0.161286 Oct 24 08:54:45.339203 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 384/765] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:45 2022] GET /compute/v2.1/servers/f4e45239-d466-49f2-841c-596152dddd18 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:45.785648 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-04764767-46ea-4647-9244-e097bc46cf36 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:45.786261 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-04764767-46ea-4647-9244-e097bc46cf36 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:45.793235 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-04764767-46ea-4647-9244-e097bc46cf36 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:45.794027 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-04764767-46ea-4647-9244-e097bc46cf36 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:45.794456 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-04764767-46ea-4647-9244-e097bc46cf36 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:45.795182 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-04764767-46ea-4647-9244-e097bc46cf36 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:45.795626 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-04764767-46ea-4647-9244-e097bc46cf36 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:45.796564 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-04764767-46ea-4647-9244-e097bc46cf36 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:46.014214 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-04764767-46ea-4647-9244-e097bc46cf36 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:46.029794 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-04764767-46ea-4647-9244-e097bc46cf36 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:46.032204 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-04764767-46ea-4647-9244-e097bc46cf36 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:46.034850 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-04764767-46ea-4647-9244-e097bc46cf36 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1723 microversion: 2.20 time: 0.252666 Oct 24 08:54:46.036527 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 382/766] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:45 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:46.364878 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-d3be9fe2-0f47-4980-9f95-640c293b3b4a tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:46.365959 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-d3be9fe2-0f47-4980-9f95-640c293b3b4a tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] [instance: f4e45239-d466-49f2-841c-596152dddd18] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:46.376712 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d3be9fe2-0f47-4980-9f95-640c293b3b4a tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:46.377524 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d3be9fe2-0f47-4980-9f95-640c293b3b4a tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:46.378225 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d3be9fe2-0f47-4980-9f95-640c293b3b4a tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:46.379404 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d3be9fe2-0f47-4980-9f95-640c293b3b4a tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:46.380156 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d3be9fe2-0f47-4980-9f95-640c293b3b4a tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:46.380883 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d3be9fe2-0f47-4980-9f95-640c293b3b4a tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:46.517236 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-d3be9fe2-0f47-4980-9f95-640c293b3b4a tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4806783c2df4220b7bc37090ba2b40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90625756dd824771a6221a0b919afe81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:46.528744 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-d3be9fe2-0f47-4980-9f95-640c293b3b4a tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] 10.222.0.26 "GET /compute/v2.1/servers/f4e45239-d466-49f2-841c-596152dddd18" status: 200 len: 1313 microversion: 2.1 time: 0.170257 Oct 24 08:54:46.529288 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 385/767] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:46 2022] GET /compute/v2.1/servers/f4e45239-d466-49f2-841c-596152dddd18 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:47.065219 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-53a46456-0409-41f9-95de-c29b65e58786 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:47.066236 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-53a46456-0409-41f9-95de-c29b65e58786 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:47.076039 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-53a46456-0409-41f9-95de-c29b65e58786 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:47.076530 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-53a46456-0409-41f9-95de-c29b65e58786 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:47.076966 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-53a46456-0409-41f9-95de-c29b65e58786 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:47.077661 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-53a46456-0409-41f9-95de-c29b65e58786 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:47.078116 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-53a46456-0409-41f9-95de-c29b65e58786 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:47.078536 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-53a46456-0409-41f9-95de-c29b65e58786 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:47.217723 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-53a46456-0409-41f9-95de-c29b65e58786 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:47.226401 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-53a46456-0409-41f9-95de-c29b65e58786 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:47.227882 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-53a46456-0409-41f9-95de-c29b65e58786 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:47.229043 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-53a46456-0409-41f9-95de-c29b65e58786 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1723 microversion: 2.20 time: 0.170443 Oct 24 08:54:47.229610 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 383/768] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:47 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:47.559929 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-e56f0566-2ee5-4842-8ec2-61990d59e6ff tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:47.560579 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-e56f0566-2ee5-4842-8ec2-61990d59e6ff tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] [instance: f4e45239-d466-49f2-841c-596152dddd18] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:47.566659 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e56f0566-2ee5-4842-8ec2-61990d59e6ff tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:47.567185 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e56f0566-2ee5-4842-8ec2-61990d59e6ff tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:47.567615 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e56f0566-2ee5-4842-8ec2-61990d59e6ff tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:47.568304 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e56f0566-2ee5-4842-8ec2-61990d59e6ff tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:47.568749 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e56f0566-2ee5-4842-8ec2-61990d59e6ff tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:47.569167 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e56f0566-2ee5-4842-8ec2-61990d59e6ff tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:47.698866 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-e56f0566-2ee5-4842-8ec2-61990d59e6ff tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4806783c2df4220b7bc37090ba2b40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90625756dd824771a6221a0b919afe81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:47.706760 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-e56f0566-2ee5-4842-8ec2-61990d59e6ff tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] 10.222.0.26 "GET /compute/v2.1/servers/f4e45239-d466-49f2-841c-596152dddd18" status: 200 len: 1313 microversion: 2.1 time: 0.152970 Oct 24 08:54:47.707333 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 386/769] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:47 2022] GET /compute/v2.1/servers/f4e45239-d466-49f2-841c-596152dddd18 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:48.163119 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-d24a2a6f-1724-4ad8-9277-08ed1b483997 req-92ac0e6c-0022-4f2d-a593-7c0b17a06a87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4e45239-d466-49f2-841c-596152dddd18", "name": "network-vif-plugged", "status": "completed", "tag": "ac075096-12ec-46bf-80a8-ccdf92322e2c"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:48.173966 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-d24a2a6f-1724-4ad8-9277-08ed1b483997 req-92ac0e6c-0022-4f2d-a593-7c0b17a06a87 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:48.174473 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-d24a2a6f-1724-4ad8-9277-08ed1b483997 req-92ac0e6c-0022-4f2d-a593-7c0b17a06a87 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:48.174940 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-d24a2a6f-1724-4ad8-9277-08ed1b483997 req-92ac0e6c-0022-4f2d-a593-7c0b17a06a87 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:48.186109 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-d24a2a6f-1724-4ad8-9277-08ed1b483997 req-92ac0e6c-0022-4f2d-a593-7c0b17a06a87 service nova] Creating event network-vif-plugged:ac075096-12ec-46bf-80a8-ccdf92322e2c for instance f4e45239-d466-49f2-841c-596152dddd18 on hv-cinder-maste Oct 24 08:54:48.191214 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-d24a2a6f-1724-4ad8-9277-08ed1b483997 req-92ac0e6c-0022-4f2d-a593-7c0b17a06a87 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031905 Oct 24 08:54:48.191896 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 384/770] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:54:48.253980 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-9762df2d-ce55-4276-a2f6-b54b11a142c0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:48.254500 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-9762df2d-ce55-4276-a2f6-b54b11a142c0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:48.260919 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9762df2d-ce55-4276-a2f6-b54b11a142c0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:48.261436 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9762df2d-ce55-4276-a2f6-b54b11a142c0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:48.261851 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9762df2d-ce55-4276-a2f6-b54b11a142c0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:48.262546 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9762df2d-ce55-4276-a2f6-b54b11a142c0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:48.263025 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9762df2d-ce55-4276-a2f6-b54b11a142c0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:48.263449 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9762df2d-ce55-4276-a2f6-b54b11a142c0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:48.399940 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell0:SELECT=8 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:48.429651 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-9762df2d-ce55-4276-a2f6-b54b11a142c0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:48.438260 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-9762df2d-ce55-4276-a2f6-b54b11a142c0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:48.439739 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-9762df2d-ce55-4276-a2f6-b54b11a142c0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:48.440913 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-9762df2d-ce55-4276-a2f6-b54b11a142c0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1723 microversion: 2.20 time: 0.191159 Oct 24 08:54:48.441477 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 387/771] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:48 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:48.726883 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell0:SELECT=2 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:48.727763 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell0:SELECT=12 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:48.732384 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-2f3efa2b-eb22-460f-871e-d229ee76b4f5 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:48.733121 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-2f3efa2b-eb22-460f-871e-d229ee76b4f5 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] [instance: f4e45239-d466-49f2-841c-596152dddd18] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:48.740056 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2f3efa2b-eb22-460f-871e-d229ee76b4f5 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:48.740534 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2f3efa2b-eb22-460f-871e-d229ee76b4f5 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:48.740959 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2f3efa2b-eb22-460f-871e-d229ee76b4f5 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:48.741628 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2f3efa2b-eb22-460f-871e-d229ee76b4f5 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:48.742097 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2f3efa2b-eb22-460f-871e-d229ee76b4f5 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:48.742509 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2f3efa2b-eb22-460f-871e-d229ee76b4f5 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:48.877066 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-2f3efa2b-eb22-460f-871e-d229ee76b4f5 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4806783c2df4220b7bc37090ba2b40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90625756dd824771a6221a0b919afe81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:48.889148 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-2f3efa2b-eb22-460f-871e-d229ee76b4f5 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] 10.222.0.26 "GET /compute/v2.1/servers/f4e45239-d466-49f2-841c-596152dddd18" status: 200 len: 1313 microversion: 2.1 time: 0.163045 Oct 24 08:54:48.889987 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 385/772] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:48 2022] GET /compute/v2.1/servers/f4e45239-d466-49f2-841c-596152dddd18 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:49.469998 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-1329e028-bf0f-4e44-bb3b-7642bc1ddb6b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:49.470953 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-1329e028-bf0f-4e44-bb3b-7642bc1ddb6b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:49.482056 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1329e028-bf0f-4e44-bb3b-7642bc1ddb6b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:49.482835 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1329e028-bf0f-4e44-bb3b-7642bc1ddb6b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:49.483276 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1329e028-bf0f-4e44-bb3b-7642bc1ddb6b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:49.483969 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1329e028-bf0f-4e44-bb3b-7642bc1ddb6b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:49.484418 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1329e028-bf0f-4e44-bb3b-7642bc1ddb6b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:49.484842 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1329e028-bf0f-4e44-bb3b-7642bc1ddb6b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:49.618324 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-1329e028-bf0f-4e44-bb3b-7642bc1ddb6b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:49.627257 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-1329e028-bf0f-4e44-bb3b-7642bc1ddb6b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:49.628687 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-1329e028-bf0f-4e44-bb3b-7642bc1ddb6b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:49.629892 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-1329e028-bf0f-4e44-bb3b-7642bc1ddb6b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1723 microversion: 2.20 time: 0.166616 Oct 24 08:54:49.630457 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 388/773] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:49 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:49.915888 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-659a7840-facb-4316-b438-8e423e930bc2 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:49.916847 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-659a7840-facb-4316-b438-8e423e930bc2 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] [instance: f4e45239-d466-49f2-841c-596152dddd18] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:49.924830 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-659a7840-facb-4316-b438-8e423e930bc2 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:49.925314 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-659a7840-facb-4316-b438-8e423e930bc2 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:49.925800 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-659a7840-facb-4316-b438-8e423e930bc2 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:49.926486 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-659a7840-facb-4316-b438-8e423e930bc2 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:49.926957 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-659a7840-facb-4316-b438-8e423e930bc2 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:49.927373 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-659a7840-facb-4316-b438-8e423e930bc2 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:50.063813 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-659a7840-facb-4316-b438-8e423e930bc2 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4806783c2df4220b7bc37090ba2b40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90625756dd824771a6221a0b919afe81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:50.071549 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-659a7840-facb-4316-b438-8e423e930bc2 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] 10.222.0.26 "GET /compute/v2.1/servers/f4e45239-d466-49f2-841c-596152dddd18" status: 200 len: 1313 microversion: 2.1 time: 0.162095 Oct 24 08:54:50.072117 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 386/774] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:49 2022] GET /compute/v2.1/servers/f4e45239-d466-49f2-841c-596152dddd18 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:50.659781 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-f7514cf7-691e-4a09-8d94-248d8c659ed0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:50.660763 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-f7514cf7-691e-4a09-8d94-248d8c659ed0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:50.671776 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f7514cf7-691e-4a09-8d94-248d8c659ed0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:50.672257 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f7514cf7-691e-4a09-8d94-248d8c659ed0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:50.672680 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f7514cf7-691e-4a09-8d94-248d8c659ed0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:50.673362 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f7514cf7-691e-4a09-8d94-248d8c659ed0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:50.673807 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f7514cf7-691e-4a09-8d94-248d8c659ed0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:50.674218 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f7514cf7-691e-4a09-8d94-248d8c659ed0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:50.815254 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-f7514cf7-691e-4a09-8d94-248d8c659ed0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:50.827579 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-f7514cf7-691e-4a09-8d94-248d8c659ed0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:50.829310 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-f7514cf7-691e-4a09-8d94-248d8c659ed0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:50.830475 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-f7514cf7-691e-4a09-8d94-248d8c659ed0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1723 microversion: 2.20 time: 0.177355 Oct 24 08:54:50.831046 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 389/775] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:50 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:51.096316 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-94399594-7e7c-4353-8eec-e08ed9cf5b3b tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:51.096933 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-94399594-7e7c-4353-8eec-e08ed9cf5b3b tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] [instance: f4e45239-d466-49f2-841c-596152dddd18] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:51.103829 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-94399594-7e7c-4353-8eec-e08ed9cf5b3b tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:51.104310 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-94399594-7e7c-4353-8eec-e08ed9cf5b3b tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:51.104734 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-94399594-7e7c-4353-8eec-e08ed9cf5b3b tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:51.105415 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-94399594-7e7c-4353-8eec-e08ed9cf5b3b tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:51.105829 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-94399594-7e7c-4353-8eec-e08ed9cf5b3b tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:51.106279 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-94399594-7e7c-4353-8eec-e08ed9cf5b3b tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:51.239437 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-94399594-7e7c-4353-8eec-e08ed9cf5b3b tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4806783c2df4220b7bc37090ba2b40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90625756dd824771a6221a0b919afe81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:51.252191 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-94399594-7e7c-4353-8eec-e08ed9cf5b3b tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] 10.222.0.26 "GET /compute/v2.1/servers/f4e45239-d466-49f2-841c-596152dddd18" status: 200 len: 1497 microversion: 2.1 time: 0.160822 Oct 24 08:54:51.253097 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 387/776] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:51 2022] GET /compute/v2.1/servers/f4e45239-d466-49f2-841c-596152dddd18 => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:51.860300 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-16e31c4e-8c67-48c2-b5e6-ce30e42753e2 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:51.861177 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-16e31c4e-8c67-48c2-b5e6-ce30e42753e2 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:51.871873 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-16e31c4e-8c67-48c2-b5e6-ce30e42753e2 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:51.872719 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-16e31c4e-8c67-48c2-b5e6-ce30e42753e2 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:51.873431 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-16e31c4e-8c67-48c2-b5e6-ce30e42753e2 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:51.874562 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-16e31c4e-8c67-48c2-b5e6-ce30e42753e2 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:51.875356 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-16e31c4e-8c67-48c2-b5e6-ce30e42753e2 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:51.876050 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-16e31c4e-8c67-48c2-b5e6-ce30e42753e2 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:52.023559 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-16e31c4e-8c67-48c2-b5e6-ce30e42753e2 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:52.035725 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-16e31c4e-8c67-48c2-b5e6-ce30e42753e2 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:52.037887 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-16e31c4e-8c67-48c2-b5e6-ce30e42753e2 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:52.039619 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-16e31c4e-8c67-48c2-b5e6-ce30e42753e2 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1723 microversion: 2.20 time: 0.185842 Oct 24 08:54:52.040389 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 390/777] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:51 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:53.068153 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-b3ff9252-b0d0-4db3-a5d4-28fe869f02ec tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:53.068805 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-b3ff9252-b0d0-4db3-a5d4-28fe869f02ec tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:53.075578 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b3ff9252-b0d0-4db3-a5d4-28fe869f02ec tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:53.076057 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b3ff9252-b0d0-4db3-a5d4-28fe869f02ec tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:53.076488 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b3ff9252-b0d0-4db3-a5d4-28fe869f02ec tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:53.077169 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b3ff9252-b0d0-4db3-a5d4-28fe869f02ec tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:53.077625 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b3ff9252-b0d0-4db3-a5d4-28fe869f02ec tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:53.078039 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b3ff9252-b0d0-4db3-a5d4-28fe869f02ec tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:53.210753 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-b3ff9252-b0d0-4db3-a5d4-28fe869f02ec tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:53.221045 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-b3ff9252-b0d0-4db3-a5d4-28fe869f02ec tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:53.222501 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-b3ff9252-b0d0-4db3-a5d4-28fe869f02ec tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:53.223682 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-b3ff9252-b0d0-4db3-a5d4-28fe869f02ec tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1723 microversion: 2.20 time: 0.159600 Oct 24 08:54:53.224242 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 388/778] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:53 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:53.677120 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-bf9f9ee5-b336-4cee-b1f1-792ce34694c8 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:53.677653 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-bf9f9ee5-b336-4cee-b1f1-792ce34694c8 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] [instance: f4e45239-d466-49f2-841c-596152dddd18] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:53.684671 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bf9f9ee5-b336-4cee-b1f1-792ce34694c8 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:53.685161 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bf9f9ee5-b336-4cee-b1f1-792ce34694c8 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:53.685595 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bf9f9ee5-b336-4cee-b1f1-792ce34694c8 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:53.686283 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bf9f9ee5-b336-4cee-b1f1-792ce34694c8 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:53.686760 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bf9f9ee5-b336-4cee-b1f1-792ce34694c8 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:53.687178 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bf9f9ee5-b336-4cee-b1f1-792ce34694c8 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:53.712511 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-bf9f9ee5-b336-4cee-b1f1-792ce34694c8 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] [instance: f4e45239-d466-49f2-841c-596152dddd18] Going to try to terminate instance {{(pid=125164) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:54:53.799783 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-bf9f9ee5-b336-4cee-b1f1-792ce34694c8 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f4e45239-d466-49f2-841c-596152dddd18" status: 204 len: 0 microversion: 2.1 time: 0.125563 Oct 24 08:54:53.800518 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 391/779] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Oct 24 08:54:53 2022] DELETE /compute/v2.1/servers/f4e45239-d466-49f2-841c-596152dddd18 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:54:53.809018 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-8acea4e7-fcc0-4458-8035-9508ad543065 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:53.809661 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-8acea4e7-fcc0-4458-8035-9508ad543065 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] [instance: f4e45239-d466-49f2-841c-596152dddd18] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:53.815872 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8acea4e7-fcc0-4458-8035-9508ad543065 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:53.816353 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8acea4e7-fcc0-4458-8035-9508ad543065 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:53.816782 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8acea4e7-fcc0-4458-8035-9508ad543065 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:53.817459 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8acea4e7-fcc0-4458-8035-9508ad543065 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:53.817902 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8acea4e7-fcc0-4458-8035-9508ad543065 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:53.818317 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8acea4e7-fcc0-4458-8035-9508ad543065 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:53.950544 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-8acea4e7-fcc0-4458-8035-9508ad543065 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4806783c2df4220b7bc37090ba2b40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90625756dd824771a6221a0b919afe81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:53.961650 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-8acea4e7-fcc0-4458-8035-9508ad543065 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] 10.222.0.26 "GET /compute/v2.1/servers/f4e45239-d466-49f2-841c-596152dddd18" status: 200 len: 1503 microversion: 2.1 time: 0.156390 Oct 24 08:54:53.962397 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 389/780] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:53 2022] GET /compute/v2.1/servers/f4e45239-d466-49f2-841c-596152dddd18 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:54.251252 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-1351a47b-301d-4202-92b4-a2208b7405d9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:54.252224 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-1351a47b-301d-4202-92b4-a2208b7405d9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:54.258985 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1351a47b-301d-4202-92b4-a2208b7405d9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:54.259461 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1351a47b-301d-4202-92b4-a2208b7405d9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:54.259915 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1351a47b-301d-4202-92b4-a2208b7405d9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:54.260603 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1351a47b-301d-4202-92b4-a2208b7405d9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:54.261050 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1351a47b-301d-4202-92b4-a2208b7405d9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:54.261484 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1351a47b-301d-4202-92b4-a2208b7405d9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:54.392509 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-1351a47b-301d-4202-92b4-a2208b7405d9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:54.401109 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-1351a47b-301d-4202-92b4-a2208b7405d9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:54.402542 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-1351a47b-301d-4202-92b4-a2208b7405d9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:54.403757 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-1351a47b-301d-4202-92b4-a2208b7405d9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1723 microversion: 2.20 time: 0.158050 Oct 24 08:54:54.404361 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 392/781] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:54 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:54.988723 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-f6dc6acf-4a2b-429d-b206-c9978442ee5a tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:54.989407 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-f6dc6acf-4a2b-429d-b206-c9978442ee5a tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] [instance: f4e45239-d466-49f2-841c-596152dddd18] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:54.996307 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f6dc6acf-4a2b-429d-b206-c9978442ee5a tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:54.996795 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f6dc6acf-4a2b-429d-b206-c9978442ee5a tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:54.997226 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f6dc6acf-4a2b-429d-b206-c9978442ee5a tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:54.997912 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f6dc6acf-4a2b-429d-b206-c9978442ee5a tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:54.998361 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f6dc6acf-4a2b-429d-b206-c9978442ee5a tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:54.998808 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f6dc6acf-4a2b-429d-b206-c9978442ee5a tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:55.127938 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-f6dc6acf-4a2b-429d-b206-c9978442ee5a tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4806783c2df4220b7bc37090ba2b40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90625756dd824771a6221a0b919afe81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:55.136445 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-f6dc6acf-4a2b-429d-b206-c9978442ee5a tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] 10.222.0.26 "GET /compute/v2.1/servers/f4e45239-d466-49f2-841c-596152dddd18" status: 200 len: 1503 microversion: 2.1 time: 0.152144 Oct 24 08:54:55.137099 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 390/782] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:54 2022] GET /compute/v2.1/servers/f4e45239-d466-49f2-841c-596152dddd18 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:55.434293 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-78d05bfc-8e6c-4ddb-bd00-735b6f093f37 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:55.435329 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-78d05bfc-8e6c-4ddb-bd00-735b6f093f37 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:55.444372 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-78d05bfc-8e6c-4ddb-bd00-735b6f093f37 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:55.444854 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-78d05bfc-8e6c-4ddb-bd00-735b6f093f37 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:55.445284 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-78d05bfc-8e6c-4ddb-bd00-735b6f093f37 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:55.445963 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-78d05bfc-8e6c-4ddb-bd00-735b6f093f37 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:55.446416 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-78d05bfc-8e6c-4ddb-bd00-735b6f093f37 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:55.446864 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-78d05bfc-8e6c-4ddb-bd00-735b6f093f37 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:55.612700 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-78d05bfc-8e6c-4ddb-bd00-735b6f093f37 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:55.621699 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-78d05bfc-8e6c-4ddb-bd00-735b6f093f37 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:55.623146 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-78d05bfc-8e6c-4ddb-bd00-735b6f093f37 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:55.624325 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-78d05bfc-8e6c-4ddb-bd00-735b6f093f37 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1723 microversion: 2.20 time: 0.196728 Oct 24 08:54:55.625120 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 393/783] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:55 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:56.019317 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-ea6ca441-7329-49fb-8579-0fcb93e75ac2 req-d5900ab9-f8c6-4f6d-9d10-abdb3cf6ae65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4e45239-d466-49f2-841c-596152dddd18", "name": "network-vif-deleted", "tag": "ac075096-12ec-46bf-80a8-ccdf92322e2c"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:54:56.025168 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:56.031653 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-ea6ca441-7329-49fb-8579-0fcb93e75ac2 req-d5900ab9-f8c6-4f6d-9d10-abdb3cf6ae65 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:56.032150 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-ea6ca441-7329-49fb-8579-0fcb93e75ac2 req-d5900ab9-f8c6-4f6d-9d10-abdb3cf6ae65 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:56.032558 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-ea6ca441-7329-49fb-8579-0fcb93e75ac2 req-d5900ab9-f8c6-4f6d-9d10-abdb3cf6ae65 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:56.045679 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-ea6ca441-7329-49fb-8579-0fcb93e75ac2 req-d5900ab9-f8c6-4f6d-9d10-abdb3cf6ae65 service nova] Creating event network-vif-deleted:ac075096-12ec-46bf-80a8-ccdf92322e2c for instance f4e45239-d466-49f2-841c-596152dddd18 on hv-cinder-maste Oct 24 08:54:56.051471 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-ea6ca441-7329-49fb-8579-0fcb93e75ac2 req-d5900ab9-f8c6-4f6d-9d10-abdb3cf6ae65 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036329 Oct 24 08:54:56.052084 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 391/784] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:54:56.161397 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-0078a83f-96fe-40a6-aefc-15f973552263 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:56.162080 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-0078a83f-96fe-40a6-aefc-15f973552263 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] [instance: f4e45239-d466-49f2-841c-596152dddd18] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:56.168875 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0078a83f-96fe-40a6-aefc-15f973552263 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:56.169386 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0078a83f-96fe-40a6-aefc-15f973552263 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:56.170014 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0078a83f-96fe-40a6-aefc-15f973552263 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:56.170732 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0078a83f-96fe-40a6-aefc-15f973552263 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:56.171192 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0078a83f-96fe-40a6-aefc-15f973552263 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:56.171997 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0078a83f-96fe-40a6-aefc-15f973552263 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:56.205183 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0078a83f-96fe-40a6-aefc-15f973552263 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:56.205562 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0078a83f-96fe-40a6-aefc-15f973552263 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:56.206018 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0078a83f-96fe-40a6-aefc-15f973552263 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:56.206468 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.objects.instance [None req-0078a83f-96fe-40a6-aefc-15f973552263 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lazy-loading 'fault' on Instance uuid f4e45239-d466-49f2-841c-596152dddd18 {{(pid=125164) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:54:56.253387 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-0078a83f-96fe-40a6-aefc-15f973552263 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4806783c2df4220b7bc37090ba2b40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90625756dd824771a6221a0b919afe81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:56.272353 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-0078a83f-96fe-40a6-aefc-15f973552263 tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] 10.222.0.26 "GET /compute/v2.1/servers/f4e45239-d466-49f2-841c-596152dddd18" status: 200 len: 1303 microversion: 2.1 time: 0.114836 Oct 24 08:54:56.273108 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 394/785] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:56 2022] GET /compute/v2.1/servers/f4e45239-d466-49f2-841c-596152dddd18 => generated 1303 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:54:56.654755 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-3aba6ea2-bd74-4728-b9df-a829a31a6e81 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:56.655991 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-3aba6ea2-bd74-4728-b9df-a829a31a6e81 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:56.667518 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3aba6ea2-bd74-4728-b9df-a829a31a6e81 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:56.668340 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3aba6ea2-bd74-4728-b9df-a829a31a6e81 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:56.669024 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3aba6ea2-bd74-4728-b9df-a829a31a6e81 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:56.670609 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3aba6ea2-bd74-4728-b9df-a829a31a6e81 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:56.671758 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3aba6ea2-bd74-4728-b9df-a829a31a6e81 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:56.672436 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3aba6ea2-bd74-4728-b9df-a829a31a6e81 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:56.804262 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-3aba6ea2-bd74-4728-b9df-a829a31a6e81 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:56.812901 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-3aba6ea2-bd74-4728-b9df-a829a31a6e81 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:56.814306 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-3aba6ea2-bd74-4728-b9df-a829a31a6e81 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:56.815483 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-3aba6ea2-bd74-4728-b9df-a829a31a6e81 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1723 microversion: 2.20 time: 0.167916 Oct 24 08:54:56.816037 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 392/786] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:56 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:57.299581 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-d1e4134b-7de2-4829-a74d-b4af1bcb24cc tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:57.300591 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-d1e4134b-7de2-4829-a74d-b4af1bcb24cc tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] [instance: f4e45239-d466-49f2-841c-596152dddd18] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:57.303643 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:57.310231 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d1e4134b-7de2-4829-a74d-b4af1bcb24cc tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:57.310794 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d1e4134b-7de2-4829-a74d-b4af1bcb24cc tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:57.311239 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d1e4134b-7de2-4829-a74d-b4af1bcb24cc tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:57.311933 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d1e4134b-7de2-4829-a74d-b4af1bcb24cc tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:57.312384 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d1e4134b-7de2-4829-a74d-b4af1bcb24cc tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:57.312803 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d1e4134b-7de2-4829-a74d-b4af1bcb24cc tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:57.315914 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:57.331205 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.wsgi [None req-d1e4134b-7de2-4829-a74d-b4af1bcb24cc tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] HTTP exception thrown: Instance f4e45239-d466-49f2-841c-596152dddd18 could not be found. Oct 24 08:54:57.333304 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-d1e4134b-7de2-4829-a74d-b4af1bcb24cc tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Request method failure captured: Oct 24 08:54:57.333304 dv-cinder-master-3-smb devstack@n-api.service[125164]: request: GET /compute/v2.1/servers/f4e45239-d466-49f2-841c-596152dddd18 HTTP/1.1 Oct 24 08:54:57.333304 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept: application/json Oct 24 08:54:57.333304 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept-Encoding: identity Oct 24 08:54:57.333304 dv-cinder-master-3-smb devstack@n-api.service[125164]: Connection: close Oct 24 08:54:57.333304 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Length: 0 Oct 24 08:54:57.333304 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Type: application/json Oct 24 08:54:57.333304 dv-cinder-master-3-smb devstack@n-api.service[125164]: Host: 10.222.0.26 Oct 24 08:54:57.333304 dv-cinder-master-3-smb devstack@n-api.service[125164]: Openstack-System-Scope: None Oct 24 08:54:57.333304 dv-cinder-master-3-smb devstack@n-api.service[125164]: User-Agent: python-urllib3/1.26.12 Oct 24 08:54:57.333304 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Auth-Token: gAAAAABjVlLMrTb6d8bwSzw6VJTKVkuJsGlfbL4SNoZTz8NtVhPgIgFC02sfV5kyCdRwzbmKO2J740J6tW9Fd6qUxknJpIGPav2PuslaHt9_A49jN6y_90JCZI99wRG98wulIMJ1D1pCJ42wzyBeIPTeNY6P4vBbQNuiXxFksgZGHwevPu_mmbE Oct 24 08:54:57.333304 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Id: None Oct 24 08:54:57.333304 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Name: None Oct 24 08:54:57.333304 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Identity-Status: Confirmed Oct 24 08:54:57.333304 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Is-Admin-Project: True Oct 24 08:54:57.333304 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Id: default Oct 24 08:54:57.333304 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Name: Default Oct 24 08:54:57.333304 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Id: 90625756dd824771a6221a0b919afe81 Oct 24 08:54:57.333304 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Name: tempest-VolumesActionsTest-419984953 Oct 24 08:54:57.333304 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Role: reader,member Oct 24 08:54:57.333304 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Roles: reader,member Oct 24 08:54:57.335027 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_90625756dd824771a6221a0b919afe81", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/90625756dd824771a6221a0b919afe81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/90625756dd824771a6221a0b919afe81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/90625756dd824771a6221a0b919afe81"}]}] Oct 24 08:54:57.335027 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant: tempest-VolumesActionsTest-419984953 Oct 24 08:54:57.335027 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Id: 90625756dd824771a6221a0b919afe81 Oct 24 08:54:57.335027 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Name: tempest-VolumesActionsTest-419984953 Oct 24 08:54:57.335027 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User: tempest-VolumesActionsTest-419984953-project Oct 24 08:54:57.335027 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Id: default Oct 24 08:54:57.335027 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Name: Default Oct 24 08:54:57.335027 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Id: f4806783c2df4220b7bc37090ba2b40d Oct 24 08:54:57.335027 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Name: tempest-VolumesActionsTest-419984953-project Oct 24 08:54:57.335027 dv-cinder-master-3-smb devstack@n-api.service[125164]: method: > Oct 24 08:54:57.335027 dv-cinder-master-3-smb devstack@n-api.service[125164]: exception: Instance f4e45239-d466-49f2-841c-596152dddd18 could not be found. Oct 24 08:54:57.335027 dv-cinder-master-3-smb devstack@n-api.service[125164]: action_args: {'id': 'f4e45239-d466-49f2-841c-596152dddd18'} Oct 24 08:54:57.335910 dv-cinder-master-3-smb devstack@n-api.service[125164]: {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:54:57.335910 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:57.335910 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:54:57.335910 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:54:57.335910 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:54:57.335910 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:54:57.335910 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:54:57.335910 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:54:57.335910 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:54:57.335910 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:54:57.335910 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4e45239-d466-49f2-841c-596152dddd18 could not be found. Oct 24 08:54:57.335910 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:54:57.335910 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:54:57.335910 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:54:57.335910 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:57.335910 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:54:57.335910 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:54:57.335910 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:54:57.335910 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:54:57.335910 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:54:57.337219 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:54:57.337219 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:54:57.337219 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:54:57.337219 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:54:57.337219 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:54:57.337219 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:54:57.337219 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:54:57.337219 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4e45239-d466-49f2-841c-596152dddd18 could not be found. Oct 24 08:54:57.337219 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:54:57.337219 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:54:57.337219 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:54:57.337219 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:54:57.337219 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:54:57.337219 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:54:57.337219 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:54:57.337219 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:54:57.337219 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4e45239-d466-49f2-841c-596152dddd18 could not be found. Oct 24 08:54:57.337219 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:54:57.338355 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-d1e4134b-7de2-4829-a74d-b4af1bcb24cc tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] Returning 404 to user: Instance f4e45239-d466-49f2-841c-596152dddd18 could not be found. {{(pid=125164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:54:57.338355 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-d1e4134b-7de2-4829-a74d-b4af1bcb24cc tempest-VolumesActionsTest-419984953 tempest-VolumesActionsTest-419984953-project] 10.222.0.26 "GET /compute/v2.1/servers/f4e45239-d466-49f2-841c-596152dddd18" status: 404 len: 111 microversion: 2.1 time: 0.042383 Oct 24 08:54:57.338355 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 395/787] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:54:57 2022] GET /compute/v2.1/servers/f4e45239-d466-49f2-841c-596152dddd18 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:54:57.845955 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-47f0906e-43af-4a7c-b0ca-8f71d4714b89 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:57.846858 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-47f0906e-43af-4a7c-b0ca-8f71d4714b89 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:57.854247 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-47f0906e-43af-4a7c-b0ca-8f71d4714b89 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:57.854747 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-47f0906e-43af-4a7c-b0ca-8f71d4714b89 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:57.855187 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-47f0906e-43af-4a7c-b0ca-8f71d4714b89 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:57.855863 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-47f0906e-43af-4a7c-b0ca-8f71d4714b89 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:57.856311 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-47f0906e-43af-4a7c-b0ca-8f71d4714b89 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:57.856728 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-47f0906e-43af-4a7c-b0ca-8f71d4714b89 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:57.991833 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-47f0906e-43af-4a7c-b0ca-8f71d4714b89 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:58.000293 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-47f0906e-43af-4a7c-b0ca-8f71d4714b89 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:58.001738 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-47f0906e-43af-4a7c-b0ca-8f71d4714b89 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:58.002913 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-47f0906e-43af-4a7c-b0ca-8f71d4714b89 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1744 microversion: 2.20 time: 0.164015 Oct 24 08:54:58.003476 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 393/788] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:57 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:54:59.031049 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-122ca6a4-9db8-4e76-aa20-e31983594637 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:54:59.031656 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-122ca6a4-9db8-4e76-aa20-e31983594637 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:54:59.042477 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-122ca6a4-9db8-4e76-aa20-e31983594637 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:59.043121 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-122ca6a4-9db8-4e76-aa20-e31983594637 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:59.043607 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-122ca6a4-9db8-4e76-aa20-e31983594637 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:59.044458 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-122ca6a4-9db8-4e76-aa20-e31983594637 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:54:59.045079 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-122ca6a4-9db8-4e76-aa20-e31983594637 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:54:59.045712 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-122ca6a4-9db8-4e76-aa20-e31983594637 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:54:59.191233 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-122ca6a4-9db8-4e76-aa20-e31983594637 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:59.199728 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-122ca6a4-9db8-4e76-aa20-e31983594637 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:59.201147 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-122ca6a4-9db8-4e76-aa20-e31983594637 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:54:59.202311 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-122ca6a4-9db8-4e76-aa20-e31983594637 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1744 microversion: 2.20 time: 0.177963 Oct 24 08:54:59.202987 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 396/789] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:54:59 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1744 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:00.171169 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-d894432d-76a0-424d-857b-e2cb98592e07 req-80a11727-1c4a-4617-a3c3-46c516a8f0e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa2753cf-624f-4bf1-b85b-0fef0e35521c", "name": "network-vif-plugged", "status": "completed", "tag": "8db8d394-e903-4fe4-92d4-9750c49eb4c4"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:55:00.176332 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-d894432d-76a0-424d-857b-e2cb98592e07 req-80a11727-1c4a-4617-a3c3-46c516a8f0e4 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:00.177009 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-d894432d-76a0-424d-857b-e2cb98592e07 req-80a11727-1c4a-4617-a3c3-46c516a8f0e4 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:00.177652 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-d894432d-76a0-424d-857b-e2cb98592e07 req-80a11727-1c4a-4617-a3c3-46c516a8f0e4 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:00.189302 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-d894432d-76a0-424d-857b-e2cb98592e07 req-80a11727-1c4a-4617-a3c3-46c516a8f0e4 service nova] Creating event network-vif-plugged:8db8d394-e903-4fe4-92d4-9750c49eb4c4 for instance aa2753cf-624f-4bf1-b85b-0fef0e35521c on hv-cinder-maste Oct 24 08:55:00.195218 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-d894432d-76a0-424d-857b-e2cb98592e07 req-80a11727-1c4a-4617-a3c3-46c516a8f0e4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032622 Oct 24 08:55:00.196183 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 394/790] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:55:00.228283 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-7fd62496-a201-4e60-9745-3f1686af728f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:00.228902 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-7fd62496-a201-4e60-9745-3f1686af728f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:00.235695 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7fd62496-a201-4e60-9745-3f1686af728f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:00.236562 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7fd62496-a201-4e60-9745-3f1686af728f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:00.237075 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7fd62496-a201-4e60-9745-3f1686af728f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:00.238034 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7fd62496-a201-4e60-9745-3f1686af728f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:00.238667 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7fd62496-a201-4e60-9745-3f1686af728f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:00.239257 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7fd62496-a201-4e60-9745-3f1686af728f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:00.374463 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-7fd62496-a201-4e60-9745-3f1686af728f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:00.383250 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-7fd62496-a201-4e60-9745-3f1686af728f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:00.384688 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-7fd62496-a201-4e60-9745-3f1686af728f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:00.385891 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-7fd62496-a201-4e60-9745-3f1686af728f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1744 microversion: 2.20 time: 0.161941 Oct 24 08:55:00.386423 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 397/791] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:00 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:01.412591 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-357062cb-cbd7-48af-bb69-0be5973057bf tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:01.413272 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-357062cb-cbd7-48af-bb69-0be5973057bf tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:01.420215 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-357062cb-cbd7-48af-bb69-0be5973057bf tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:01.420695 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-357062cb-cbd7-48af-bb69-0be5973057bf tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:01.421124 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-357062cb-cbd7-48af-bb69-0be5973057bf tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:01.422177 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-357062cb-cbd7-48af-bb69-0be5973057bf tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:01.422630 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-357062cb-cbd7-48af-bb69-0be5973057bf tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:01.423083 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-357062cb-cbd7-48af-bb69-0be5973057bf tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:01.437651 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell1:SELECT=100 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:01.556243 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-357062cb-cbd7-48af-bb69-0be5973057bf tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:01.565211 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-357062cb-cbd7-48af-bb69-0be5973057bf tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:01.566658 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-357062cb-cbd7-48af-bb69-0be5973057bf tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:01.567848 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-357062cb-cbd7-48af-bb69-0be5973057bf tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1744 microversion: 2.20 time: 0.160102 Oct 24 08:55:01.568730 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 395/792] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:01 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:02.602495 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-460c984c-778d-42c0-83d7-d0475813d8c3 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:02.603373 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-460c984c-778d-42c0-83d7-d0475813d8c3 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:02.610652 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-460c984c-778d-42c0-83d7-d0475813d8c3 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:02.611211 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-460c984c-778d-42c0-83d7-d0475813d8c3 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:02.611649 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-460c984c-778d-42c0-83d7-d0475813d8c3 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:02.612347 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-460c984c-778d-42c0-83d7-d0475813d8c3 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:02.612802 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-460c984c-778d-42c0-83d7-d0475813d8c3 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:02.613224 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-460c984c-778d-42c0-83d7-d0475813d8c3 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:02.750720 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-460c984c-778d-42c0-83d7-d0475813d8c3 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:02.759018 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-460c984c-778d-42c0-83d7-d0475813d8c3 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:02.760452 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-460c984c-778d-42c0-83d7-d0475813d8c3 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:02.761680 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-460c984c-778d-42c0-83d7-d0475813d8c3 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1744 microversion: 2.20 time: 0.163904 Oct 24 08:55:02.762257 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 398/793] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:02 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:03.362738 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-2be997aa-dad2-4bed-a39c-fcac1cf7f619 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:03.363361 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-2be997aa-dad2-4bed-a39c-fcac1cf7f619 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 575d6bbd-9138-4599-8ffe-06b113b9ea99] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:03.370174 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2be997aa-dad2-4bed-a39c-fcac1cf7f619 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:03.370659 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2be997aa-dad2-4bed-a39c-fcac1cf7f619 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:03.371181 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2be997aa-dad2-4bed-a39c-fcac1cf7f619 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:03.372575 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2be997aa-dad2-4bed-a39c-fcac1cf7f619 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:03.373037 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2be997aa-dad2-4bed-a39c-fcac1cf7f619 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:03.373460 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2be997aa-dad2-4bed-a39c-fcac1cf7f619 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:03.401270 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-2be997aa-dad2-4bed-a39c-fcac1cf7f619 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99/ips" status: 200 len: 145 microversion: 2.1 time: 0.042442 Oct 24 08:55:03.401826 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 396/794] 10.222.0.26 () {58 vars in 1248 bytes} [Mon Oct 24 08:55:03 2022] GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99/ips => generated 145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:55:03.786995 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-ec776fbd-d2a1-4014-addc-30d04d0c509b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:03.787652 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-ec776fbd-d2a1-4014-addc-30d04d0c509b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:03.795807 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ec776fbd-d2a1-4014-addc-30d04d0c509b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:03.795807 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ec776fbd-d2a1-4014-addc-30d04d0c509b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:03.797963 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ec776fbd-d2a1-4014-addc-30d04d0c509b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:03.800048 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ec776fbd-d2a1-4014-addc-30d04d0c509b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:03.800774 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ec776fbd-d2a1-4014-addc-30d04d0c509b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:03.801410 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ec776fbd-d2a1-4014-addc-30d04d0c509b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:03.985112 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-ec776fbd-d2a1-4014-addc-30d04d0c509b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:03.994959 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-ec776fbd-d2a1-4014-addc-30d04d0c509b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:03.998814 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-ec776fbd-d2a1-4014-addc-30d04d0c509b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:04.000571 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-ec776fbd-d2a1-4014-addc-30d04d0c509b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1739 microversion: 2.20 time: 0.217825 Oct 24 08:55:04.001572 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 399/795] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:03 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:04.775056 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-461c2403-4532-4212-8e9f-bb72cbf4e348 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "def9edb8-e890-4672-81da-f7cec710a68b"}} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:55:04.778070 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-461c2403-4532-4212-8e9f-bb72cbf4e348 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 575d6bbd-9138-4599-8ffe-06b113b9ea99] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:04.785742 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-461c2403-4532-4212-8e9f-bb72cbf4e348 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:04.786544 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-461c2403-4532-4212-8e9f-bb72cbf4e348 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:04.787079 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-461c2403-4532-4212-8e9f-bb72cbf4e348 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:04.787879 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-461c2403-4532-4212-8e9f-bb72cbf4e348 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:04.788367 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-461c2403-4532-4212-8e9f-bb72cbf4e348 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:04.788967 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-461c2403-4532-4212-8e9f-bb72cbf4e348 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:05.027854 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-5cf93963-8962-4ee0-807c-0ae316503620 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:05.028629 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-5cf93963-8962-4ee0-807c-0ae316503620 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:05.039273 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5cf93963-8962-4ee0-807c-0ae316503620 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:05.040531 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5cf93963-8962-4ee0-807c-0ae316503620 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:05.041186 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5cf93963-8962-4ee0-807c-0ae316503620 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:05.042116 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5cf93963-8962-4ee0-807c-0ae316503620 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:05.042790 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5cf93963-8962-4ee0-807c-0ae316503620 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:05.043514 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5cf93963-8962-4ee0-807c-0ae316503620 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:05.129558 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-461c2403-4532-4212-8e9f-bb72cbf4e348 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "POST /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.359425 Oct 24 08:55:05.151685 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 397/796] 10.222.0.26 () {60 vars in 1323 bytes} [Mon Oct 24 08:55:04 2022] POST /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99/os-volume_attachments => generated 194 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:55:05.294466 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-5cf93963-8962-4ee0-807c-0ae316503620 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:05.308082 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-5cf93963-8962-4ee0-807c-0ae316503620 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:05.309511 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-5cf93963-8962-4ee0-807c-0ae316503620 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:05.311026 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-5cf93963-8962-4ee0-807c-0ae316503620 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1739 microversion: 2.20 time: 0.288424 Oct 24 08:55:05.312123 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 400/797] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:05 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1739 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:06.338039 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-4935765a-25de-44aa-972c-8761cccd6742 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:06.338890 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-4935765a-25de-44aa-972c-8761cccd6742 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:06.346111 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4935765a-25de-44aa-972c-8761cccd6742 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:06.346867 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4935765a-25de-44aa-972c-8761cccd6742 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:06.347577 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4935765a-25de-44aa-972c-8761cccd6742 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:06.348212 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4935765a-25de-44aa-972c-8761cccd6742 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:06.348905 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4935765a-25de-44aa-972c-8761cccd6742 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:06.349419 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4935765a-25de-44aa-972c-8761cccd6742 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:06.491884 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-4935765a-25de-44aa-972c-8761cccd6742 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:06.500717 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-4935765a-25de-44aa-972c-8761cccd6742 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:06.502064 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-4935765a-25de-44aa-972c-8761cccd6742 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:06.503256 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-4935765a-25de-44aa-972c-8761cccd6742 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1739 microversion: 2.20 time: 0.169571 Oct 24 08:55:06.504908 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 398/798] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:06 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:55:07.459051 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-7752d2d7-1a38-407d-83bf-8ceb30135a52 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:07.462361 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-7752d2d7-1a38-407d-83bf-8ceb30135a52 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 575d6bbd-9138-4599-8ffe-06b113b9ea99] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:07.469344 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7752d2d7-1a38-407d-83bf-8ceb30135a52 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:07.470149 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7752d2d7-1a38-407d-83bf-8ceb30135a52 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:07.470798 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7752d2d7-1a38-407d-83bf-8ceb30135a52 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:07.471698 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7752d2d7-1a38-407d-83bf-8ceb30135a52 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:07.472335 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7752d2d7-1a38-407d-83bf-8ceb30135a52 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:07.472918 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7752d2d7-1a38-407d-83bf-8ceb30135a52 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:07.506469 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-7752d2d7-1a38-407d-83bf-8ceb30135a52 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051574 Oct 24 08:55:07.507095 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 401/799] 10.222.0.26 () {58 vars in 1302 bytes} [Mon Oct 24 08:55:07 2022] GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:55:07.518919 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-27cba228-25c0-4d45-ba01-01d8ef126711 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:07.519618 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-27cba228-25c0-4d45-ba01-01d8ef126711 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 575d6bbd-9138-4599-8ffe-06b113b9ea99] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:07.526872 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-27cba228-25c0-4d45-ba01-01d8ef126711 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:07.527664 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-27cba228-25c0-4d45-ba01-01d8ef126711 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:07.528272 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-27cba228-25c0-4d45-ba01-01d8ef126711 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:07.529185 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-27cba228-25c0-4d45-ba01-01d8ef126711 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:07.529584 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-c013089a-70c5-44d7-a193-e738cc436d68 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:07.530008 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-27cba228-25c0-4d45-ba01-01d8ef126711 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:07.530558 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-c013089a-70c5-44d7-a193-e738cc436d68 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:07.530792 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-27cba228-25c0-4d45-ba01-01d8ef126711 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:07.537178 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c013089a-70c5-44d7-a193-e738cc436d68 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:07.537702 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c013089a-70c5-44d7-a193-e738cc436d68 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:07.538166 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c013089a-70c5-44d7-a193-e738cc436d68 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:07.539070 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c013089a-70c5-44d7-a193-e738cc436d68 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:07.539721 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c013089a-70c5-44d7-a193-e738cc436d68 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:07.540828 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c013089a-70c5-44d7-a193-e738cc436d68 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:07.568690 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-27cba228-25c0-4d45-ba01-01d8ef126711 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99/os-volume_attachments/def9edb8-e890-4672-81da-f7cec710a68b" status: 200 len: 194 microversion: 2.1 time: 0.053591 Oct 24 08:55:07.575045 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 399/800] 10.222.0.26 () {58 vars in 1413 bytes} [Mon Oct 24 08:55:07 2022] GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99/os-volume_attachments/def9edb8-e890-4672-81da-f7cec710a68b => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:55:07.735780 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-c013089a-70c5-44d7-a193-e738cc436d68 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:07.753051 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-c013089a-70c5-44d7-a193-e738cc436d68 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:07.754536 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-c013089a-70c5-44d7-a193-e738cc436d68 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:07.759437 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-c013089a-70c5-44d7-a193-e738cc436d68 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1739 microversion: 2.20 time: 0.230671 Oct 24 08:55:07.775469 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 402/801] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:07 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1739 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:08.785946 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-1777a043-a55a-46c0-aa5f-7c90e5a57a59 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:08.787351 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-1777a043-a55a-46c0-aa5f-7c90e5a57a59 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:08.794749 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1777a043-a55a-46c0-aa5f-7c90e5a57a59 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:08.795294 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1777a043-a55a-46c0-aa5f-7c90e5a57a59 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:08.795752 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1777a043-a55a-46c0-aa5f-7c90e5a57a59 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:08.796465 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1777a043-a55a-46c0-aa5f-7c90e5a57a59 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:08.797254 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1777a043-a55a-46c0-aa5f-7c90e5a57a59 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:08.797705 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1777a043-a55a-46c0-aa5f-7c90e5a57a59 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:08.943311 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-1777a043-a55a-46c0-aa5f-7c90e5a57a59 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:08.965388 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-1777a043-a55a-46c0-aa5f-7c90e5a57a59 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:08.966935 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-1777a043-a55a-46c0-aa5f-7c90e5a57a59 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:08.968228 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-1777a043-a55a-46c0-aa5f-7c90e5a57a59 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1739 microversion: 2.20 time: 0.186273 Oct 24 08:55:08.973145 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 400/802] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:08 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:09.027165 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-19e31130-7f9f-4903-aaa6-5bf5e5a76933 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36d0404d-7789-49ac-b7a6-c1152e9e0418"}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:55:09.030487 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-19e31130-7f9f-4903-aaa6-5bf5e5a76933 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 575d6bbd-9138-4599-8ffe-06b113b9ea99] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:09.037664 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-19e31130-7f9f-4903-aaa6-5bf5e5a76933 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:09.038375 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-19e31130-7f9f-4903-aaa6-5bf5e5a76933 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:09.039095 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-19e31130-7f9f-4903-aaa6-5bf5e5a76933 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:09.040287 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-19e31130-7f9f-4903-aaa6-5bf5e5a76933 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:09.040988 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-19e31130-7f9f-4903-aaa6-5bf5e5a76933 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:09.041537 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-19e31130-7f9f-4903-aaa6-5bf5e5a76933 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:09.409865 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-19e31130-7f9f-4903-aaa6-5bf5e5a76933 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "POST /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.386636 Oct 24 08:55:09.410799 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 403/803] 10.222.0.26 () {60 vars in 1323 bytes} [Mon Oct 24 08:55:09 2022] POST /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99/os-volume_attachments => generated 194 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:55:09.996502 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-3c2ba02b-c2e3-4d53-b02c-b89a52f1331f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:09.997872 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-3c2ba02b-c2e3-4d53-b02c-b89a52f1331f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:10.005839 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3c2ba02b-c2e3-4d53-b02c-b89a52f1331f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:10.005839 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3c2ba02b-c2e3-4d53-b02c-b89a52f1331f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:10.006227 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3c2ba02b-c2e3-4d53-b02c-b89a52f1331f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:10.006935 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3c2ba02b-c2e3-4d53-b02c-b89a52f1331f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:10.007375 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3c2ba02b-c2e3-4d53-b02c-b89a52f1331f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:10.007976 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3c2ba02b-c2e3-4d53-b02c-b89a52f1331f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:10.149372 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-3c2ba02b-c2e3-4d53-b02c-b89a52f1331f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:10.159664 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-3c2ba02b-c2e3-4d53-b02c-b89a52f1331f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:10.161671 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-3c2ba02b-c2e3-4d53-b02c-b89a52f1331f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:10.162935 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-3c2ba02b-c2e3-4d53-b02c-b89a52f1331f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1739 microversion: 2.20 time: 0.171928 Oct 24 08:55:10.163481 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 401/804] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:09 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:11.189723 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-b3305846-56b6-4e68-8e19-d6bae99a3c0a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:11.191281 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-b3305846-56b6-4e68-8e19-d6bae99a3c0a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:11.199603 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b3305846-56b6-4e68-8e19-d6bae99a3c0a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:11.200277 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b3305846-56b6-4e68-8e19-d6bae99a3c0a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:11.200985 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b3305846-56b6-4e68-8e19-d6bae99a3c0a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:11.201861 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b3305846-56b6-4e68-8e19-d6bae99a3c0a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:11.202462 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b3305846-56b6-4e68-8e19-d6bae99a3c0a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:11.203053 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b3305846-56b6-4e68-8e19-d6bae99a3c0a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:11.357696 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-b3305846-56b6-4e68-8e19-d6bae99a3c0a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:11.371921 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-b3305846-56b6-4e68-8e19-d6bae99a3c0a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:11.373438 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-b3305846-56b6-4e68-8e19-d6bae99a3c0a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:11.375238 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-b3305846-56b6-4e68-8e19-d6bae99a3c0a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1739 microversion: 2.20 time: 0.190276 Oct 24 08:55:11.376390 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 404/805] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:11 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:11.785381 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-6461fd86-2ac1-493b-953b-087ed2d22e77 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:11.788341 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-6461fd86-2ac1-493b-953b-087ed2d22e77 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 575d6bbd-9138-4599-8ffe-06b113b9ea99] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:11.795801 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6461fd86-2ac1-493b-953b-087ed2d22e77 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:11.796532 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6461fd86-2ac1-493b-953b-087ed2d22e77 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:11.797459 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6461fd86-2ac1-493b-953b-087ed2d22e77 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:11.798980 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6461fd86-2ac1-493b-953b-087ed2d22e77 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:11.800461 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6461fd86-2ac1-493b-953b-087ed2d22e77 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:11.801093 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6461fd86-2ac1-493b-953b-087ed2d22e77 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:11.839292 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-6461fd86-2ac1-493b-953b-087ed2d22e77 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.058686 Oct 24 08:55:11.840474 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 402/806] 10.222.0.26 () {58 vars in 1302 bytes} [Mon Oct 24 08:55:11 2022] GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99/os-volume_attachments => generated 371 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:55:11.981213 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-220d3de8-382c-4f42-8afc-34915075e3a8 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:11.981714 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-220d3de8-382c-4f42-8afc-34915075e3a8 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 575d6bbd-9138-4599-8ffe-06b113b9ea99] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:11.988350 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-220d3de8-382c-4f42-8afc-34915075e3a8 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:11.988896 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-220d3de8-382c-4f42-8afc-34915075e3a8 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:11.989561 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-220d3de8-382c-4f42-8afc-34915075e3a8 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:11.990561 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-220d3de8-382c-4f42-8afc-34915075e3a8 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:11.991228 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-220d3de8-382c-4f42-8afc-34915075e3a8 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:11.991795 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-220d3de8-382c-4f42-8afc-34915075e3a8 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:12.024536 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-220d3de8-382c-4f42-8afc-34915075e3a8 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99/os-volume_attachments/def9edb8-e890-4672-81da-f7cec710a68b" status: 200 len: 194 microversion: 2.1 time: 0.047598 Oct 24 08:55:12.025413 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 405/807] 10.222.0.26 () {58 vars in 1413 bytes} [Mon Oct 24 08:55:11 2022] GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99/os-volume_attachments/def9edb8-e890-4672-81da-f7cec710a68b => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:55:12.035982 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-f16d2f90-1b0f-447c-a178-512d391c9a0f tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:12.036858 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-f16d2f90-1b0f-447c-a178-512d391c9a0f tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 575d6bbd-9138-4599-8ffe-06b113b9ea99] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:12.043656 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f16d2f90-1b0f-447c-a178-512d391c9a0f tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:12.044370 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f16d2f90-1b0f-447c-a178-512d391c9a0f tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:12.044799 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f16d2f90-1b0f-447c-a178-512d391c9a0f tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:12.045488 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f16d2f90-1b0f-447c-a178-512d391c9a0f tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:12.045934 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f16d2f90-1b0f-447c-a178-512d391c9a0f tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:12.046354 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f16d2f90-1b0f-447c-a178-512d391c9a0f tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:12.138667 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.objects.instance [None req-f16d2f90-1b0f-447c-a178-512d391c9a0f tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lazy-loading 'services' on Instance uuid 575d6bbd-9138-4599-8ffe-06b113b9ea99 {{(pid=125165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:55:12.224923 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-f16d2f90-1b0f-447c-a178-512d391c9a0f tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "DELETE /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99/os-volume_attachments/def9edb8-e890-4672-81da-f7cec710a68b" status: 202 len: 0 microversion: 2.1 time: 0.192320 Oct 24 08:55:12.225629 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 403/808] 10.222.0.26 () {58 vars in 1416 bytes} [Mon Oct 24 08:55:12 2022] DELETE /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99/os-volume_attachments/def9edb8-e890-4672-81da-f7cec710a68b => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 08:55:12.403413 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-e7ea9a3a-517d-430d-8ce4-1d3f76084d4a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:12.406322 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-e7ea9a3a-517d-430d-8ce4-1d3f76084d4a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:12.413217 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e7ea9a3a-517d-430d-8ce4-1d3f76084d4a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:12.414026 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e7ea9a3a-517d-430d-8ce4-1d3f76084d4a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:12.415117 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e7ea9a3a-517d-430d-8ce4-1d3f76084d4a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:12.416105 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e7ea9a3a-517d-430d-8ce4-1d3f76084d4a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:12.417007 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e7ea9a3a-517d-430d-8ce4-1d3f76084d4a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:12.417649 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e7ea9a3a-517d-430d-8ce4-1d3f76084d4a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:12.644823 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-e7ea9a3a-517d-430d-8ce4-1d3f76084d4a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:12.654672 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-e7ea9a3a-517d-430d-8ce4-1d3f76084d4a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:12.656263 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-e7ea9a3a-517d-430d-8ce4-1d3f76084d4a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:12.657752 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-e7ea9a3a-517d-430d-8ce4-1d3f76084d4a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1739 microversion: 2.20 time: 0.260478 Oct 24 08:55:12.658409 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 406/809] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:12 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1739 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:13.690842 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-81d88dc3-a55a-4f07-b0df-698b00e9f3c0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:13.692426 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-81d88dc3-a55a-4f07-b0df-698b00e9f3c0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:13.699231 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-81d88dc3-a55a-4f07-b0df-698b00e9f3c0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:13.699927 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-81d88dc3-a55a-4f07-b0df-698b00e9f3c0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:13.700705 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-81d88dc3-a55a-4f07-b0df-698b00e9f3c0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:13.701567 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-81d88dc3-a55a-4f07-b0df-698b00e9f3c0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:13.702294 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-81d88dc3-a55a-4f07-b0df-698b00e9f3c0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:13.702939 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-81d88dc3-a55a-4f07-b0df-698b00e9f3c0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:13.937226 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-81d88dc3-a55a-4f07-b0df-698b00e9f3c0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:13.947991 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-81d88dc3-a55a-4f07-b0df-698b00e9f3c0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:13.949954 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-81d88dc3-a55a-4f07-b0df-698b00e9f3c0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:13.951421 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-81d88dc3-a55a-4f07-b0df-698b00e9f3c0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1739 microversion: 2.20 time: 0.265696 Oct 24 08:55:13.952488 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 404/810] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:13 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1739 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:14.460197 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-5dfbd3a4-faae-4551-a91b-cd05e7b008bd tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:14.460757 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-5dfbd3a4-faae-4551-a91b-cd05e7b008bd tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 575d6bbd-9138-4599-8ffe-06b113b9ea99] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:14.468651 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5dfbd3a4-faae-4551-a91b-cd05e7b008bd tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:14.469212 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5dfbd3a4-faae-4551-a91b-cd05e7b008bd tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:14.469710 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5dfbd3a4-faae-4551-a91b-cd05e7b008bd tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:14.470536 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5dfbd3a4-faae-4551-a91b-cd05e7b008bd tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:14.471084 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5dfbd3a4-faae-4551-a91b-cd05e7b008bd tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:14.471567 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5dfbd3a4-faae-4551-a91b-cd05e7b008bd tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:14.502991 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-5dfbd3a4-faae-4551-a91b-cd05e7b008bd tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99/os-volume_attachments/36d0404d-7789-49ac-b7a6-c1152e9e0418" status: 200 len: 194 microversion: 2.1 time: 0.046794 Oct 24 08:55:14.503601 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 407/811] 10.222.0.26 () {58 vars in 1413 bytes} [Mon Oct 24 08:55:14 2022] GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99/os-volume_attachments/36d0404d-7789-49ac-b7a6-c1152e9e0418 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:55:14.514974 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-080b4e63-5f1e-492a-bb4c-ec0e5a789aa6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:14.515459 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-080b4e63-5f1e-492a-bb4c-ec0e5a789aa6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 575d6bbd-9138-4599-8ffe-06b113b9ea99] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:14.522175 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-080b4e63-5f1e-492a-bb4c-ec0e5a789aa6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:14.522746 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-080b4e63-5f1e-492a-bb4c-ec0e5a789aa6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:14.523217 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-080b4e63-5f1e-492a-bb4c-ec0e5a789aa6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:14.523976 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-080b4e63-5f1e-492a-bb4c-ec0e5a789aa6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:14.524747 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-080b4e63-5f1e-492a-bb4c-ec0e5a789aa6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:14.525457 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-080b4e63-5f1e-492a-bb4c-ec0e5a789aa6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:14.610096 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.objects.instance [None req-080b4e63-5f1e-492a-bb4c-ec0e5a789aa6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lazy-loading 'services' on Instance uuid 575d6bbd-9138-4599-8ffe-06b113b9ea99 {{(pid=125165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:55:14.684050 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-080b4e63-5f1e-492a-bb4c-ec0e5a789aa6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "DELETE /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99/os-volume_attachments/36d0404d-7789-49ac-b7a6-c1152e9e0418" status: 202 len: 0 microversion: 2.1 time: 0.173132 Oct 24 08:55:14.684523 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 405/812] 10.222.0.26 () {58 vars in 1416 bytes} [Mon Oct 24 08:55:14 2022] DELETE /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99/os-volume_attachments/36d0404d-7789-49ac-b7a6-c1152e9e0418 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:55:14.981172 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-d34eb1c1-59ee-4bf3-89e6-99da0d41f9fb tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:14.981790 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-d34eb1c1-59ee-4bf3-89e6-99da0d41f9fb tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:14.987793 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d34eb1c1-59ee-4bf3-89e6-99da0d41f9fb tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:14.988245 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d34eb1c1-59ee-4bf3-89e6-99da0d41f9fb tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:14.988677 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d34eb1c1-59ee-4bf3-89e6-99da0d41f9fb tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:14.989364 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d34eb1c1-59ee-4bf3-89e6-99da0d41f9fb tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:14.989815 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d34eb1c1-59ee-4bf3-89e6-99da0d41f9fb tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:14.990236 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d34eb1c1-59ee-4bf3-89e6-99da0d41f9fb tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:15.149816 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-d34eb1c1-59ee-4bf3-89e6-99da0d41f9fb tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:15.158590 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-d34eb1c1-59ee-4bf3-89e6-99da0d41f9fb tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:15.160219 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-d34eb1c1-59ee-4bf3-89e6-99da0d41f9fb tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:15.161262 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-d34eb1c1-59ee-4bf3-89e6-99da0d41f9fb tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1739 microversion: 2.20 time: 0.184554 Oct 24 08:55:15.161863 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 408/813] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:14 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:16.187274 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-a394cac8-80f8-4b71-94b0-14ce354caea5 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:16.189124 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-a394cac8-80f8-4b71-94b0-14ce354caea5 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:16.197533 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a394cac8-80f8-4b71-94b0-14ce354caea5 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:16.198273 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a394cac8-80f8-4b71-94b0-14ce354caea5 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:16.198959 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a394cac8-80f8-4b71-94b0-14ce354caea5 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:16.199831 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a394cac8-80f8-4b71-94b0-14ce354caea5 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:16.200454 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a394cac8-80f8-4b71-94b0-14ce354caea5 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:16.201546 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a394cac8-80f8-4b71-94b0-14ce354caea5 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:16.677402 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a394cac8-80f8-4b71-94b0-14ce354caea5 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:16.687252 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a394cac8-80f8-4b71-94b0-14ce354caea5 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:16.689140 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a394cac8-80f8-4b71-94b0-14ce354caea5 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:16.690537 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-a394cac8-80f8-4b71-94b0-14ce354caea5 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1721 microversion: 2.20 time: 0.507515 Oct 24 08:55:16.692117 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 406/814] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:16 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1721 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:16.917910 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-a44942f5-9850-4b3a-bbcc-8d71dc452345 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:16.920235 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-a44942f5-9850-4b3a-bbcc-8d71dc452345 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 575d6bbd-9138-4599-8ffe-06b113b9ea99] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:16.928000 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a44942f5-9850-4b3a-bbcc-8d71dc452345 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:16.928495 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a44942f5-9850-4b3a-bbcc-8d71dc452345 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:16.928929 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a44942f5-9850-4b3a-bbcc-8d71dc452345 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:16.929629 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a44942f5-9850-4b3a-bbcc-8d71dc452345 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:16.930340 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a44942f5-9850-4b3a-bbcc-8d71dc452345 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:16.930795 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a44942f5-9850-4b3a-bbcc-8d71dc452345 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:16.962191 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-a44942f5-9850-4b3a-bbcc-8d71dc452345 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047686 Oct 24 08:55:16.966846 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 409/815] 10.222.0.26 () {58 vars in 1302 bytes} [Mon Oct 24 08:55:16 2022] GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:55:17.079787 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-2f75de8c-981e-4ff8-8693-eb4e3c76a440 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:17.082362 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-2f75de8c-981e-4ff8-8693-eb4e3c76a440 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 575d6bbd-9138-4599-8ffe-06b113b9ea99] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:17.089295 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2f75de8c-981e-4ff8-8693-eb4e3c76a440 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:17.089786 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2f75de8c-981e-4ff8-8693-eb4e3c76a440 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:17.090218 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2f75de8c-981e-4ff8-8693-eb4e3c76a440 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:17.090952 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2f75de8c-981e-4ff8-8693-eb4e3c76a440 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:17.091406 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2f75de8c-981e-4ff8-8693-eb4e3c76a440 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:17.091831 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2f75de8c-981e-4ff8-8693-eb4e3c76a440 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:17.121701 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-2f75de8c-981e-4ff8-8693-eb4e3c76a440 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046632 Oct 24 08:55:17.122461 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 407/816] 10.222.0.26 () {58 vars in 1302 bytes} [Mon Oct 24 08:55:17 2022] GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:55:17.194196 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-17944583-9155-432d-8d28-a67ad5fb80e3 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:17.194694 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-17944583-9155-432d-8d28-a67ad5fb80e3 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 575d6bbd-9138-4599-8ffe-06b113b9ea99] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:17.200698 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-17944583-9155-432d-8d28-a67ad5fb80e3 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:17.201189 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-17944583-9155-432d-8d28-a67ad5fb80e3 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:17.201620 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-17944583-9155-432d-8d28-a67ad5fb80e3 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:17.202317 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-17944583-9155-432d-8d28-a67ad5fb80e3 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:17.202787 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-17944583-9155-432d-8d28-a67ad5fb80e3 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:17.203212 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-17944583-9155-432d-8d28-a67ad5fb80e3 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:17.228075 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-17944583-9155-432d-8d28-a67ad5fb80e3 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 575d6bbd-9138-4599-8ffe-06b113b9ea99] Going to try to terminate instance {{(pid=125164) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:55:17.242760 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:17.317871 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-17944583-9155-432d-8d28-a67ad5fb80e3 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "DELETE /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99" status: 204 len: 0 microversion: 2.1 time: 0.127093 Oct 24 08:55:17.318463 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 410/817] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Oct 24 08:55:17 2022] DELETE /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:55:17.326853 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-53d28749-fb03-4b0e-97ee-e862d4e627b8 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:17.327491 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-53d28749-fb03-4b0e-97ee-e862d4e627b8 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 575d6bbd-9138-4599-8ffe-06b113b9ea99] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:17.333782 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-53d28749-fb03-4b0e-97ee-e862d4e627b8 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:17.334299 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-53d28749-fb03-4b0e-97ee-e862d4e627b8 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:17.334729 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-53d28749-fb03-4b0e-97ee-e862d4e627b8 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:17.335424 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-53d28749-fb03-4b0e-97ee-e862d4e627b8 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:17.336050 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-53d28749-fb03-4b0e-97ee-e862d4e627b8 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:17.336478 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-53d28749-fb03-4b0e-97ee-e862d4e627b8 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:17.468480 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-53d28749-fb03-4b0e-97ee-e862d4e627b8 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:17.476060 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-53d28749-fb03-4b0e-97ee-e862d4e627b8 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99" status: 200 len: 1672 microversion: 2.1 time: 0.153052 Oct 24 08:55:17.476606 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 408/818] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:17 2022] GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:17.716975 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-cc3294b9-12a9-49ad-8708-08981d16a374 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:17.717918 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-cc3294b9-12a9-49ad-8708-08981d16a374 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:17.724088 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cc3294b9-12a9-49ad-8708-08981d16a374 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:17.724566 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cc3294b9-12a9-49ad-8708-08981d16a374 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:17.725012 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cc3294b9-12a9-49ad-8708-08981d16a374 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:17.725726 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cc3294b9-12a9-49ad-8708-08981d16a374 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:17.726265 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cc3294b9-12a9-49ad-8708-08981d16a374 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:17.726674 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cc3294b9-12a9-49ad-8708-08981d16a374 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:17.865252 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-cc3294b9-12a9-49ad-8708-08981d16a374 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:17.873572 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-cc3294b9-12a9-49ad-8708-08981d16a374 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:17.875032 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-cc3294b9-12a9-49ad-8708-08981d16a374 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:17.876212 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-cc3294b9-12a9-49ad-8708-08981d16a374 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1721 microversion: 2.20 time: 0.163509 Oct 24 08:55:17.876772 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 411/819] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:17 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:18.248332 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-f6141ffb-80a6-46ca-bc1a-6ecde2d01802 req-cdbd035a-e870-46a5-bebf-dd4f06baae1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa2753cf-624f-4bf1-b85b-0fef0e35521c", "name": "network-vif-unplugged", "status": "completed", "tag": "8db8d394-e903-4fe4-92d4-9750c49eb4c4"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:55:18.259565 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-f6141ffb-80a6-46ca-bc1a-6ecde2d01802 req-cdbd035a-e870-46a5-bebf-dd4f06baae1a service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:18.260243 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-f6141ffb-80a6-46ca-bc1a-6ecde2d01802 req-cdbd035a-e870-46a5-bebf-dd4f06baae1a service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:18.262100 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-f6141ffb-80a6-46ca-bc1a-6ecde2d01802 req-cdbd035a-e870-46a5-bebf-dd4f06baae1a service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:18.273821 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-f6141ffb-80a6-46ca-bc1a-6ecde2d01802 req-cdbd035a-e870-46a5-bebf-dd4f06baae1a service nova] Creating event network-vif-unplugged:8db8d394-e903-4fe4-92d4-9750c49eb4c4 for instance aa2753cf-624f-4bf1-b85b-0fef0e35521c on hv-cinder-maste Oct 24 08:55:18.280566 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-f6141ffb-80a6-46ca-bc1a-6ecde2d01802 req-cdbd035a-e870-46a5-bebf-dd4f06baae1a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037870 Oct 24 08:55:18.281365 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 409/820] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:55:18.499897 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-ba0e9bc0-470d-4d1d-aded-5f85eea2f509 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:18.500532 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-ba0e9bc0-470d-4d1d-aded-5f85eea2f509 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 575d6bbd-9138-4599-8ffe-06b113b9ea99] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:18.507312 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ba0e9bc0-470d-4d1d-aded-5f85eea2f509 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:18.507805 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ba0e9bc0-470d-4d1d-aded-5f85eea2f509 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:18.508241 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ba0e9bc0-470d-4d1d-aded-5f85eea2f509 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:18.509009 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ba0e9bc0-470d-4d1d-aded-5f85eea2f509 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:18.509436 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ba0e9bc0-470d-4d1d-aded-5f85eea2f509 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:18.509848 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ba0e9bc0-470d-4d1d-aded-5f85eea2f509 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:18.642174 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-ba0e9bc0-470d-4d1d-aded-5f85eea2f509 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:18.650336 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-ba0e9bc0-470d-4d1d-aded-5f85eea2f509 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99" status: 200 len: 1672 microversion: 2.1 time: 0.154466 Oct 24 08:55:18.650943 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 412/821] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:18 2022] GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:18.905028 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-f9137418-b48c-4cc7-9676-5b6aaa020454 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:18.905714 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-f9137418-b48c-4cc7-9676-5b6aaa020454 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:18.911945 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f9137418-b48c-4cc7-9676-5b6aaa020454 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:18.912430 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f9137418-b48c-4cc7-9676-5b6aaa020454 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:18.912872 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f9137418-b48c-4cc7-9676-5b6aaa020454 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:18.913555 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f9137418-b48c-4cc7-9676-5b6aaa020454 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:18.914004 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f9137418-b48c-4cc7-9676-5b6aaa020454 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:18.914422 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f9137418-b48c-4cc7-9676-5b6aaa020454 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:18.929343 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:19.055974 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-f9137418-b48c-4cc7-9676-5b6aaa020454 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:19.064230 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-f9137418-b48c-4cc7-9676-5b6aaa020454 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:19.065635 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-f9137418-b48c-4cc7-9676-5b6aaa020454 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:19.066836 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-f9137418-b48c-4cc7-9676-5b6aaa020454 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1721 microversion: 2.20 time: 0.167763 Oct 24 08:55:19.067392 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 410/822] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:18 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:19.676747 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-483517db-2b56-4d00-a2c8-ffdab6db3c8c tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:19.677336 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-483517db-2b56-4d00-a2c8-ffdab6db3c8c tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 575d6bbd-9138-4599-8ffe-06b113b9ea99] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:19.684437 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-483517db-2b56-4d00-a2c8-ffdab6db3c8c tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:19.685002 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-483517db-2b56-4d00-a2c8-ffdab6db3c8c tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:19.685441 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-483517db-2b56-4d00-a2c8-ffdab6db3c8c tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:19.686204 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-483517db-2b56-4d00-a2c8-ffdab6db3c8c tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:19.686739 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-483517db-2b56-4d00-a2c8-ffdab6db3c8c tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:19.687173 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-483517db-2b56-4d00-a2c8-ffdab6db3c8c tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:19.821452 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-483517db-2b56-4d00-a2c8-ffdab6db3c8c tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:19.829919 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-483517db-2b56-4d00-a2c8-ffdab6db3c8c tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99" status: 200 len: 1672 microversion: 2.1 time: 0.157616 Oct 24 08:55:19.830498 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 413/823] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:19 2022] GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:20.091463 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-91162726-d37a-4d0b-84df-b22dd41cffef tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:20.092081 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-91162726-d37a-4d0b-84df-b22dd41cffef tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:20.098239 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-91162726-d37a-4d0b-84df-b22dd41cffef tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:20.098711 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-91162726-d37a-4d0b-84df-b22dd41cffef tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:20.099157 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-91162726-d37a-4d0b-84df-b22dd41cffef tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:20.099840 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-91162726-d37a-4d0b-84df-b22dd41cffef tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:20.100277 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-91162726-d37a-4d0b-84df-b22dd41cffef tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:20.100694 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-91162726-d37a-4d0b-84df-b22dd41cffef tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:20.235970 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-91162726-d37a-4d0b-84df-b22dd41cffef tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:20.244045 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-91162726-d37a-4d0b-84df-b22dd41cffef tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:20.245478 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-91162726-d37a-4d0b-84df-b22dd41cffef tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:20.246610 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-91162726-d37a-4d0b-84df-b22dd41cffef tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1724 microversion: 2.20 time: 0.159007 Oct 24 08:55:20.247470 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 411/824] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:20 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:20.272595 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-23b47b68-64fc-4114-9058-4559e2caad6f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99a09735-6308-4125-b1d2-4854f6f58a61"}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:55:20.276386 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-23b47b68-64fc-4114-9058-4559e2caad6f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:20.283188 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-23b47b68-64fc-4114-9058-4559e2caad6f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:20.283681 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-23b47b68-64fc-4114-9058-4559e2caad6f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:20.284118 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-23b47b68-64fc-4114-9058-4559e2caad6f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:20.284815 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-23b47b68-64fc-4114-9058-4559e2caad6f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:20.285268 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-23b47b68-64fc-4114-9058-4559e2caad6f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:20.285691 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-23b47b68-64fc-4114-9058-4559e2caad6f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:20.591042 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-23b47b68-64fc-4114-9058-4559e2caad6f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "POST /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.323097 Oct 24 08:55:20.591754 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 414/825] 10.222.0.26 () {62 vars in 1364 bytes} [Mon Oct 24 08:55:20 2022] POST /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c/os-volume_attachments => generated 188 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 08:55:20.732085 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-3e721f99-ab65-4ef8-8626-27647ffbaaab tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:20.732568 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-3e721f99-ab65-4ef8-8626-27647ffbaaab tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:20.738590 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3e721f99-ab65-4ef8-8626-27647ffbaaab tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:20.739108 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3e721f99-ab65-4ef8-8626-27647ffbaaab tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:20.739538 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3e721f99-ab65-4ef8-8626-27647ffbaaab tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:20.740219 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3e721f99-ab65-4ef8-8626-27647ffbaaab tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:20.740664 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3e721f99-ab65-4ef8-8626-27647ffbaaab tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:20.741079 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3e721f99-ab65-4ef8-8626-27647ffbaaab tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:20.858418 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-5181fe37-1b64-4a3d-b32e-c3779bb17c86 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:20.866375 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-5181fe37-1b64-4a3d-b32e-c3779bb17c86 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 575d6bbd-9138-4599-8ffe-06b113b9ea99] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:20.890613 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5181fe37-1b64-4a3d-b32e-c3779bb17c86 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:20.891941 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5181fe37-1b64-4a3d-b32e-c3779bb17c86 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:20.894307 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5181fe37-1b64-4a3d-b32e-c3779bb17c86 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:20.895097 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5181fe37-1b64-4a3d-b32e-c3779bb17c86 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:20.895566 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5181fe37-1b64-4a3d-b32e-c3779bb17c86 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:20.895996 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5181fe37-1b64-4a3d-b32e-c3779bb17c86 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:21.023938 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-3e721f99-ab65-4ef8-8626-27647ffbaaab tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "DELETE /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c/os-volume_attachments/99a09735-6308-4125-b1d2-4854f6f58a61" status: 202 len: 0 microversion: 2.20 time: 0.295791 Oct 24 08:55:21.024532 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 412/826] 10.222.0.26 () {60 vars in 1457 bytes} [Mon Oct 24 08:55:20 2022] DELETE /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c/os-volume_attachments/99a09735-6308-4125-b1d2-4854f6f58a61 => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:55:21.086564 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-c4e76f24-cf1d-4e53-92c1-f9c56473cc75 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:55:21.087411 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-c4e76f24-cf1d-4e53-92c1-f9c56473cc75 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:21.093621 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c4e76f24-cf1d-4e53-92c1-f9c56473cc75 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:21.094207 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c4e76f24-cf1d-4e53-92c1-f9c56473cc75 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:21.094521 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c4e76f24-cf1d-4e53-92c1-f9c56473cc75 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:21.095214 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c4e76f24-cf1d-4e53-92c1-f9c56473cc75 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:21.095677 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c4e76f24-cf1d-4e53-92c1-f9c56473cc75 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:21.096088 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c4e76f24-cf1d-4e53-92c1-f9c56473cc75 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:21.141514 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-5181fe37-1b64-4a3d-b32e-c3779bb17c86 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:21.146470 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-c4e76f24-cf1d-4e53-92c1-f9c56473cc75 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125165) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 24 08:55:21.150342 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-5181fe37-1b64-4a3d-b32e-c3779bb17c86 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99" status: 200 len: 1672 microversion: 2.1 time: 0.296483 Oct 24 08:55:21.151151 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 415/827] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:20 2022] GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99 => generated 1672 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:21.217179 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-c4e76f24-cf1d-4e53-92c1-f9c56473cc75 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "POST /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c/action" status: 202 len: 0 microversion: 2.20 time: 0.134526 Oct 24 08:55:21.217990 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 413/828] 10.222.0.26 () {62 vars in 1319 bytes} [Mon Oct 24 08:55:21 2022] POST /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 24 08:55:21.227008 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-521eedb3-acf9-4290-8da1-e2cd4012906f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:21.227918 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-521eedb3-acf9-4290-8da1-e2cd4012906f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:21.234453 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-521eedb3-acf9-4290-8da1-e2cd4012906f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:21.234960 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-521eedb3-acf9-4290-8da1-e2cd4012906f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:21.235544 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-521eedb3-acf9-4290-8da1-e2cd4012906f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:21.236424 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-521eedb3-acf9-4290-8da1-e2cd4012906f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:21.236870 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-521eedb3-acf9-4290-8da1-e2cd4012906f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:21.237506 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-521eedb3-acf9-4290-8da1-e2cd4012906f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:21.496837 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-521eedb3-acf9-4290-8da1-e2cd4012906f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:21.505008 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-521eedb3-acf9-4290-8da1-e2cd4012906f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:21.506753 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-521eedb3-acf9-4290-8da1-e2cd4012906f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:21.508350 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-521eedb3-acf9-4290-8da1-e2cd4012906f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1672 microversion: 2.20 time: 0.285878 Oct 24 08:55:21.523789 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 416/829] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:21 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1672 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:21.738787 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-d6705099-b187-4c80-b004-4f33160702be req-1b98f7b2-74aa-48cd-84a2-e14953b119a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "575d6bbd-9138-4599-8ffe-06b113b9ea99", "name": "network-vif-deleted", "tag": "939fa432-6068-44bb-9ea5-4b0cc46ce363"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:55:21.751832 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-d6705099-b187-4c80-b004-4f33160702be req-1b98f7b2-74aa-48cd-84a2-e14953b119a8 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:21.754172 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-d6705099-b187-4c80-b004-4f33160702be req-1b98f7b2-74aa-48cd-84a2-e14953b119a8 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:21.754700 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-d6705099-b187-4c80-b004-4f33160702be req-1b98f7b2-74aa-48cd-84a2-e14953b119a8 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:21.769000 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-d6705099-b187-4c80-b004-4f33160702be req-1b98f7b2-74aa-48cd-84a2-e14953b119a8 service nova] Creating event network-vif-deleted:939fa432-6068-44bb-9ea5-4b0cc46ce363 for instance 575d6bbd-9138-4599-8ffe-06b113b9ea99 on hv-cinder-maste Oct 24 08:55:21.776287 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-d6705099-b187-4c80-b004-4f33160702be req-1b98f7b2-74aa-48cd-84a2-e14953b119a8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041503 Oct 24 08:55:21.777872 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 414/830] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:55:22.174583 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-5d4b7a05-8be6-42a5-881a-1b5d3033eb4d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:22.175202 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-5d4b7a05-8be6-42a5-881a-1b5d3033eb4d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 575d6bbd-9138-4599-8ffe-06b113b9ea99] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:22.182202 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5d4b7a05-8be6-42a5-881a-1b5d3033eb4d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:22.182707 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5d4b7a05-8be6-42a5-881a-1b5d3033eb4d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:22.183189 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5d4b7a05-8be6-42a5-881a-1b5d3033eb4d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:22.183901 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5d4b7a05-8be6-42a5-881a-1b5d3033eb4d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:22.184350 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5d4b7a05-8be6-42a5-881a-1b5d3033eb4d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:22.184795 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5d4b7a05-8be6-42a5-881a-1b5d3033eb4d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:22.219071 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5d4b7a05-8be6-42a5-881a-1b5d3033eb4d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:22.219556 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5d4b7a05-8be6-42a5-881a-1b5d3033eb4d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:22.219979 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5d4b7a05-8be6-42a5-881a-1b5d3033eb4d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:22.220462 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.objects.instance [None req-5d4b7a05-8be6-42a5-881a-1b5d3033eb4d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lazy-loading 'fault' on Instance uuid 575d6bbd-9138-4599-8ffe-06b113b9ea99 {{(pid=125164) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:55:22.263435 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-5d4b7a05-8be6-42a5-881a-1b5d3033eb4d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d793a1f26a3467ea8119e27e3394371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b77fd80fd84c29b4581fda1ff8cef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:22.271874 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-5d4b7a05-8be6-42a5-881a-1b5d3033eb4d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99" status: 200 len: 1326 microversion: 2.1 time: 0.101696 Oct 24 08:55:22.272458 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 417/831] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:22 2022] GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99 => generated 1326 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:55:22.535533 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-0aff85f9-52c8-48b7-a64e-f6da0d862bf0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:22.536989 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-0aff85f9-52c8-48b7-a64e-f6da0d862bf0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:22.544442 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0aff85f9-52c8-48b7-a64e-f6da0d862bf0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:22.545130 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0aff85f9-52c8-48b7-a64e-f6da0d862bf0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:22.545665 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0aff85f9-52c8-48b7-a64e-f6da0d862bf0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:22.546446 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0aff85f9-52c8-48b7-a64e-f6da0d862bf0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:22.547356 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0aff85f9-52c8-48b7-a64e-f6da0d862bf0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:22.547982 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0aff85f9-52c8-48b7-a64e-f6da0d862bf0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:22.693611 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-0aff85f9-52c8-48b7-a64e-f6da0d862bf0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:22.702082 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-0aff85f9-52c8-48b7-a64e-f6da0d862bf0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:22.703585 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-0aff85f9-52c8-48b7-a64e-f6da0d862bf0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:22.704748 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-0aff85f9-52c8-48b7-a64e-f6da0d862bf0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1730 microversion: 2.20 time: 0.173623 Oct 24 08:55:22.705387 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 415/832] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:22 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:23.295653 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-82e23fc4-675e-43cc-97f4-1fc773348ad7 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:23.296292 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-82e23fc4-675e-43cc-97f4-1fc773348ad7 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 575d6bbd-9138-4599-8ffe-06b113b9ea99] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:23.303677 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-82e23fc4-675e-43cc-97f4-1fc773348ad7 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:23.304177 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-82e23fc4-675e-43cc-97f4-1fc773348ad7 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:23.304611 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-82e23fc4-675e-43cc-97f4-1fc773348ad7 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:23.305306 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-82e23fc4-675e-43cc-97f4-1fc773348ad7 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:23.305764 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-82e23fc4-675e-43cc-97f4-1fc773348ad7 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:23.306188 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-82e23fc4-675e-43cc-97f4-1fc773348ad7 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:23.320803 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.wsgi [None req-82e23fc4-675e-43cc-97f4-1fc773348ad7 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] HTTP exception thrown: Instance 575d6bbd-9138-4599-8ffe-06b113b9ea99 could not be found. Oct 24 08:55:23.322521 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-82e23fc4-675e-43cc-97f4-1fc773348ad7 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Request method failure captured: Oct 24 08:55:23.322521 dv-cinder-master-3-smb devstack@n-api.service[125164]: request: GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99 HTTP/1.1 Oct 24 08:55:23.322521 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept: application/json Oct 24 08:55:23.322521 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept-Encoding: identity Oct 24 08:55:23.322521 dv-cinder-master-3-smb devstack@n-api.service[125164]: Connection: close Oct 24 08:55:23.322521 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Length: 0 Oct 24 08:55:23.322521 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Type: application/json Oct 24 08:55:23.322521 dv-cinder-master-3-smb devstack@n-api.service[125164]: Host: 10.222.0.26 Oct 24 08:55:23.322521 dv-cinder-master-3-smb devstack@n-api.service[125164]: Openstack-System-Scope: None Oct 24 08:55:23.322521 dv-cinder-master-3-smb devstack@n-api.service[125164]: User-Agent: python-urllib3/1.26.12 Oct 24 08:55:23.322521 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Auth-Token: gAAAAABjVlEs7zvth7MHnGv5-srWFzIELY1EVJulvVew2aEj9f6LOenv6UXPx3kmL3jEMG7S0jyRtdGO2jKPLeRZ0c32ZGEq_aJAMtG02gWOFj_aMoKatwpYO1kkmmPd1CJABfG_8pAlpaUMho-e91opS3LwG_-hYLEPuoOd7BOJhPCD_r4uk_g Oct 24 08:55:23.322521 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Id: None Oct 24 08:55:23.322521 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Name: None Oct 24 08:55:23.322521 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Identity-Status: Confirmed Oct 24 08:55:23.322521 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Is-Admin-Project: True Oct 24 08:55:23.322521 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Id: default Oct 24 08:55:23.322521 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Name: Default Oct 24 08:55:23.322521 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Id: e3b77fd80fd84c29b4581fda1ff8cef9 Oct 24 08:55:23.322521 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Name: tempest-AttachVolumeTestJSON-292776923 Oct 24 08:55:23.322521 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Role: reader,member Oct 24 08:55:23.322521 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Roles: reader,member Oct 24 08:55:23.324109 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e3b77fd80fd84c29b4581fda1ff8cef9", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e3b77fd80fd84c29b4581fda1ff8cef9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e3b77fd80fd84c29b4581fda1ff8cef9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e3b77fd80fd84c29b4581fda1ff8cef9"}]}] Oct 24 08:55:23.324109 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant: tempest-AttachVolumeTestJSON-292776923 Oct 24 08:55:23.324109 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Id: e3b77fd80fd84c29b4581fda1ff8cef9 Oct 24 08:55:23.324109 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Name: tempest-AttachVolumeTestJSON-292776923 Oct 24 08:55:23.324109 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User: tempest-AttachVolumeTestJSON-292776923-project Oct 24 08:55:23.324109 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Id: default Oct 24 08:55:23.324109 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Name: Default Oct 24 08:55:23.324109 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Id: 7d793a1f26a3467ea8119e27e3394371 Oct 24 08:55:23.324109 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Name: tempest-AttachVolumeTestJSON-292776923-project Oct 24 08:55:23.324109 dv-cinder-master-3-smb devstack@n-api.service[125164]: method: > Oct 24 08:55:23.324109 dv-cinder-master-3-smb devstack@n-api.service[125164]: exception: Instance 575d6bbd-9138-4599-8ffe-06b113b9ea99 could not be found. Oct 24 08:55:23.324109 dv-cinder-master-3-smb devstack@n-api.service[125164]: action_args: {'id': '575d6bbd-9138-4599-8ffe-06b113b9ea99'} Oct 24 08:55:23.325025 dv-cinder-master-3-smb devstack@n-api.service[125164]: {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:55:23.325025 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:23.325025 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:55:23.325025 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:55:23.325025 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:55:23.325025 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:55:23.325025 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:55:23.325025 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:55:23.325025 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:55:23.325025 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:55:23.325025 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 575d6bbd-9138-4599-8ffe-06b113b9ea99 could not be found. Oct 24 08:55:23.325025 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:23.325025 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:23.325025 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:23.325025 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:23.325025 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:23.325025 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:23.325025 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:55:23.325025 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:55:23.325025 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:55:23.326431 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:55:23.326431 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:55:23.326431 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:55:23.326431 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:55:23.326431 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:55:23.326431 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:55:23.326431 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:55:23.326431 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 575d6bbd-9138-4599-8ffe-06b113b9ea99 could not be found. Oct 24 08:55:23.326431 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:23.326431 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:23.326431 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:23.326431 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:23.326431 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:23.326431 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:23.326431 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:55:23.326431 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:55:23.326431 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 575d6bbd-9138-4599-8ffe-06b113b9ea99 could not be found. Oct 24 08:55:23.326431 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:23.327515 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-82e23fc4-675e-43cc-97f4-1fc773348ad7 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Returning 404 to user: Instance 575d6bbd-9138-4599-8ffe-06b113b9ea99 could not be found. {{(pid=125164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:55:23.327515 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-82e23fc4-675e-43cc-97f4-1fc773348ad7 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99" status: 404 len: 111 microversion: 2.1 time: 0.032451 Oct 24 08:55:23.327515 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 418/833] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:23 2022] GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:55:23.333663 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-ed0a26a5-3314-484d-b8ac-563b0d97b7a6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '.version_select at 0x7f7ef1462dc0>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:23.354584 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-ed0a26a5-3314-484d-b8ac-563b0d97b7a6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-958381151" status: 202 len: 0 microversion: 2.1 time: 0.025002 Oct 24 08:55:23.355196 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 416/834] 10.222.0.26 () {58 vars in 1218 bytes} [Mon Oct 24 08:55:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-958381151 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:55:23.731659 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-f0057775-c968-478c-829a-e4d9b664fa0d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:23.732340 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-f0057775-c968-478c-829a-e4d9b664fa0d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:23.740308 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f0057775-c968-478c-829a-e4d9b664fa0d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:23.740818 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f0057775-c968-478c-829a-e4d9b664fa0d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:23.741317 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f0057775-c968-478c-829a-e4d9b664fa0d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:23.742021 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f0057775-c968-478c-829a-e4d9b664fa0d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:23.742472 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f0057775-c968-478c-829a-e4d9b664fa0d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:23.742991 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f0057775-c968-478c-829a-e4d9b664fa0d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:23.944395 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-f0057775-c968-478c-829a-e4d9b664fa0d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:23.953009 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-f0057775-c968-478c-829a-e4d9b664fa0d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:23.954332 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-f0057775-c968-478c-829a-e4d9b664fa0d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:23.955578 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-f0057775-c968-478c-829a-e4d9b664fa0d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1730 microversion: 2.20 time: 0.228836 Oct 24 08:55:23.956199 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 419/835] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:23 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1730 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:24.991166 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-14ad96f8-cf33-4410-81ae-4c1223fdf429 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:24.992397 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-14ad96f8-cf33-4410-81ae-4c1223fdf429 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:24.999218 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-14ad96f8-cf33-4410-81ae-4c1223fdf429 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:24.999724 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-14ad96f8-cf33-4410-81ae-4c1223fdf429 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:25.000162 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-14ad96f8-cf33-4410-81ae-4c1223fdf429 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:25.000879 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-14ad96f8-cf33-4410-81ae-4c1223fdf429 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:25.001327 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-14ad96f8-cf33-4410-81ae-4c1223fdf429 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:25.001744 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-14ad96f8-cf33-4410-81ae-4c1223fdf429 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:25.140335 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-14ad96f8-cf33-4410-81ae-4c1223fdf429 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:25.149111 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-14ad96f8-cf33-4410-81ae-4c1223fdf429 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:25.150495 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-14ad96f8-cf33-4410-81ae-4c1223fdf429 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:25.151675 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-14ad96f8-cf33-4410-81ae-4c1223fdf429 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1730 microversion: 2.20 time: 0.168617 Oct 24 08:55:25.152236 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 417/836] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:24 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:26.177350 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-8ed6928c-93ef-4adc-bbb6-35e64a0db356 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:26.178603 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-8ed6928c-93ef-4adc-bbb6-35e64a0db356 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:26.185017 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8ed6928c-93ef-4adc-bbb6-35e64a0db356 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:26.185440 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8ed6928c-93ef-4adc-bbb6-35e64a0db356 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:26.185870 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8ed6928c-93ef-4adc-bbb6-35e64a0db356 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:26.186567 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8ed6928c-93ef-4adc-bbb6-35e64a0db356 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:26.187048 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8ed6928c-93ef-4adc-bbb6-35e64a0db356 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:26.187468 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8ed6928c-93ef-4adc-bbb6-35e64a0db356 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:26.322330 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-8ed6928c-93ef-4adc-bbb6-35e64a0db356 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:26.330347 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-8ed6928c-93ef-4adc-bbb6-35e64a0db356 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:26.331795 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-8ed6928c-93ef-4adc-bbb6-35e64a0db356 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:26.332958 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-8ed6928c-93ef-4adc-bbb6-35e64a0db356 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1730 microversion: 2.20 time: 0.159618 Oct 24 08:55:26.333514 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 420/837] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:26 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:26.401921 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-bd1f1bd2-9403-4789-8d6d-106f75a91a5d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:26.402763 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-bd1f1bd2-9403-4789-8d6d-106f75a91a5d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 575d6bbd-9138-4599-8ffe-06b113b9ea99] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:26.406282 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:26.412115 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bd1f1bd2-9403-4789-8d6d-106f75a91a5d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:26.412957 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bd1f1bd2-9403-4789-8d6d-106f75a91a5d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:26.413598 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bd1f1bd2-9403-4789-8d6d-106f75a91a5d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:26.414871 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bd1f1bd2-9403-4789-8d6d-106f75a91a5d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:26.415743 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bd1f1bd2-9403-4789-8d6d-106f75a91a5d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:26.416479 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bd1f1bd2-9403-4789-8d6d-106f75a91a5d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:26.438364 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.wsgi [None req-bd1f1bd2-9403-4789-8d6d-106f75a91a5d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] HTTP exception thrown: Instance 575d6bbd-9138-4599-8ffe-06b113b9ea99 could not be found. Oct 24 08:55:26.440656 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-bd1f1bd2-9403-4789-8d6d-106f75a91a5d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Request method failure captured: Oct 24 08:55:26.440656 dv-cinder-master-3-smb devstack@n-api.service[125165]: request: DELETE /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99 HTTP/1.1 Oct 24 08:55:26.440656 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept: application/json Oct 24 08:55:26.440656 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept-Encoding: identity Oct 24 08:55:26.440656 dv-cinder-master-3-smb devstack@n-api.service[125165]: Connection: close Oct 24 08:55:26.440656 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Length: 0 Oct 24 08:55:26.440656 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Type: application/json Oct 24 08:55:26.440656 dv-cinder-master-3-smb devstack@n-api.service[125165]: Host: 10.222.0.26 Oct 24 08:55:26.440656 dv-cinder-master-3-smb devstack@n-api.service[125165]: Openstack-System-Scope: None Oct 24 08:55:26.440656 dv-cinder-master-3-smb devstack@n-api.service[125165]: User-Agent: python-urllib3/1.26.12 Oct 24 08:55:26.440656 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Auth-Token: gAAAAABjVlEs7zvth7MHnGv5-srWFzIELY1EVJulvVew2aEj9f6LOenv6UXPx3kmL3jEMG7S0jyRtdGO2jKPLeRZ0c32ZGEq_aJAMtG02gWOFj_aMoKatwpYO1kkmmPd1CJABfG_8pAlpaUMho-e91opS3LwG_-hYLEPuoOd7BOJhPCD_r4uk_g Oct 24 08:55:26.440656 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Id: None Oct 24 08:55:26.440656 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Name: None Oct 24 08:55:26.440656 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Identity-Status: Confirmed Oct 24 08:55:26.440656 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Is-Admin-Project: True Oct 24 08:55:26.440656 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Id: default Oct 24 08:55:26.440656 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Name: Default Oct 24 08:55:26.440656 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Id: e3b77fd80fd84c29b4581fda1ff8cef9 Oct 24 08:55:26.440656 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Name: tempest-AttachVolumeTestJSON-292776923 Oct 24 08:55:26.440656 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Role: reader,member Oct 24 08:55:26.440656 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Roles: reader,member Oct 24 08:55:26.442555 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e3b77fd80fd84c29b4581fda1ff8cef9", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e3b77fd80fd84c29b4581fda1ff8cef9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e3b77fd80fd84c29b4581fda1ff8cef9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e3b77fd80fd84c29b4581fda1ff8cef9"}]}] Oct 24 08:55:26.442555 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant: tempest-AttachVolumeTestJSON-292776923 Oct 24 08:55:26.442555 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Id: e3b77fd80fd84c29b4581fda1ff8cef9 Oct 24 08:55:26.442555 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Name: tempest-AttachVolumeTestJSON-292776923 Oct 24 08:55:26.442555 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User: tempest-AttachVolumeTestJSON-292776923-project Oct 24 08:55:26.442555 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Id: default Oct 24 08:55:26.442555 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Name: Default Oct 24 08:55:26.442555 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Id: 7d793a1f26a3467ea8119e27e3394371 Oct 24 08:55:26.442555 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Name: tempest-AttachVolumeTestJSON-292776923-project Oct 24 08:55:26.442555 dv-cinder-master-3-smb devstack@n-api.service[125165]: method: > Oct 24 08:55:26.442555 dv-cinder-master-3-smb devstack@n-api.service[125165]: exception: Instance 575d6bbd-9138-4599-8ffe-06b113b9ea99 could not be found. Oct 24 08:55:26.442555 dv-cinder-master-3-smb devstack@n-api.service[125165]: action_args: {'id': '575d6bbd-9138-4599-8ffe-06b113b9ea99'} Oct 24 08:55:26.443716 dv-cinder-master-3-smb devstack@n-api.service[125165]: {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:55:26.443716 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:26.443716 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:55:26.443716 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:55:26.443716 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:55:26.443716 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:55:26.443716 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:55:26.443716 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:55:26.443716 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:55:26.443716 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:55:26.443716 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 575d6bbd-9138-4599-8ffe-06b113b9ea99 could not be found. Oct 24 08:55:26.443716 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:55:26.443716 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:26.443716 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:55:26.443716 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:26.443716 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:26.443716 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:26.443716 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:55:26.443716 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:55:26.443716 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:55:26.445700 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:55:26.445700 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 08:55:26.445700 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 08:55:26.445700 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 08:55:26.445700 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 08:55:26.445700 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:55:26.445700 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:55:26.445700 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:55:26.445700 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:55:26.445700 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 575d6bbd-9138-4599-8ffe-06b113b9ea99 could not be found. Oct 24 08:55:26.445700 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:55:26.445700 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:26.445700 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:55:26.445700 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:26.445700 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:26.445700 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:26.445700 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:55:26.445700 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:55:26.445700 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 575d6bbd-9138-4599-8ffe-06b113b9ea99 could not be found. Oct 24 08:55:26.445700 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:55:26.446914 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-bd1f1bd2-9403-4789-8d6d-106f75a91a5d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Returning 404 to user: Instance 575d6bbd-9138-4599-8ffe-06b113b9ea99 could not be found. {{(pid=125165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:55:26.446914 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-bd1f1bd2-9403-4789-8d6d-106f75a91a5d tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "DELETE /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99" status: 404 len: 111 microversion: 2.1 time: 0.047284 Oct 24 08:55:26.450252 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 418/838] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Oct 24 08:55:26 2022] DELETE /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:55:26.456969 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-e74f83e3-a8f8-44e7-8be3-a99a50049509 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:26.458277 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-e74f83e3-a8f8-44e7-8be3-a99a50049509 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 575d6bbd-9138-4599-8ffe-06b113b9ea99] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:26.466256 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e74f83e3-a8f8-44e7-8be3-a99a50049509 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:26.467294 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e74f83e3-a8f8-44e7-8be3-a99a50049509 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:26.468195 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e74f83e3-a8f8-44e7-8be3-a99a50049509 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:26.469292 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e74f83e3-a8f8-44e7-8be3-a99a50049509 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:26.470089 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e74f83e3-a8f8-44e7-8be3-a99a50049509 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:26.470817 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e74f83e3-a8f8-44e7-8be3-a99a50049509 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:26.487188 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.wsgi [None req-e74f83e3-a8f8-44e7-8be3-a99a50049509 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] HTTP exception thrown: Instance 575d6bbd-9138-4599-8ffe-06b113b9ea99 could not be found. Oct 24 08:55:26.489520 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-e74f83e3-a8f8-44e7-8be3-a99a50049509 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Request method failure captured: Oct 24 08:55:26.489520 dv-cinder-master-3-smb devstack@n-api.service[125164]: request: GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99 HTTP/1.1 Oct 24 08:55:26.489520 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept: application/json Oct 24 08:55:26.489520 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept-Encoding: identity Oct 24 08:55:26.489520 dv-cinder-master-3-smb devstack@n-api.service[125164]: Connection: close Oct 24 08:55:26.489520 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Length: 0 Oct 24 08:55:26.489520 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Type: application/json Oct 24 08:55:26.489520 dv-cinder-master-3-smb devstack@n-api.service[125164]: Host: 10.222.0.26 Oct 24 08:55:26.489520 dv-cinder-master-3-smb devstack@n-api.service[125164]: Openstack-System-Scope: None Oct 24 08:55:26.489520 dv-cinder-master-3-smb devstack@n-api.service[125164]: User-Agent: python-urllib3/1.26.12 Oct 24 08:55:26.489520 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Auth-Token: gAAAAABjVlEs7zvth7MHnGv5-srWFzIELY1EVJulvVew2aEj9f6LOenv6UXPx3kmL3jEMG7S0jyRtdGO2jKPLeRZ0c32ZGEq_aJAMtG02gWOFj_aMoKatwpYO1kkmmPd1CJABfG_8pAlpaUMho-e91opS3LwG_-hYLEPuoOd7BOJhPCD_r4uk_g Oct 24 08:55:26.489520 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Id: None Oct 24 08:55:26.489520 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Name: None Oct 24 08:55:26.489520 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Identity-Status: Confirmed Oct 24 08:55:26.489520 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Is-Admin-Project: True Oct 24 08:55:26.489520 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Id: default Oct 24 08:55:26.489520 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Name: Default Oct 24 08:55:26.489520 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Id: e3b77fd80fd84c29b4581fda1ff8cef9 Oct 24 08:55:26.489520 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Name: tempest-AttachVolumeTestJSON-292776923 Oct 24 08:55:26.489520 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Role: reader,member Oct 24 08:55:26.489520 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Roles: reader,member Oct 24 08:55:26.491512 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e3b77fd80fd84c29b4581fda1ff8cef9", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e3b77fd80fd84c29b4581fda1ff8cef9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e3b77fd80fd84c29b4581fda1ff8cef9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e3b77fd80fd84c29b4581fda1ff8cef9"}]}] Oct 24 08:55:26.491512 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant: tempest-AttachVolumeTestJSON-292776923 Oct 24 08:55:26.491512 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Id: e3b77fd80fd84c29b4581fda1ff8cef9 Oct 24 08:55:26.491512 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Name: tempest-AttachVolumeTestJSON-292776923 Oct 24 08:55:26.491512 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User: tempest-AttachVolumeTestJSON-292776923-project Oct 24 08:55:26.491512 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Id: default Oct 24 08:55:26.491512 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Name: Default Oct 24 08:55:26.491512 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Id: 7d793a1f26a3467ea8119e27e3394371 Oct 24 08:55:26.491512 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Name: tempest-AttachVolumeTestJSON-292776923-project Oct 24 08:55:26.491512 dv-cinder-master-3-smb devstack@n-api.service[125164]: method: > Oct 24 08:55:26.491512 dv-cinder-master-3-smb devstack@n-api.service[125164]: exception: Instance 575d6bbd-9138-4599-8ffe-06b113b9ea99 could not be found. Oct 24 08:55:26.491512 dv-cinder-master-3-smb devstack@n-api.service[125164]: action_args: {'id': '575d6bbd-9138-4599-8ffe-06b113b9ea99'} Oct 24 08:55:26.492738 dv-cinder-master-3-smb devstack@n-api.service[125164]: {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:55:26.492738 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:26.492738 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:55:26.492738 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:55:26.492738 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:55:26.492738 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:55:26.492738 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:55:26.492738 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:55:26.492738 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:55:26.492738 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:55:26.492738 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 575d6bbd-9138-4599-8ffe-06b113b9ea99 could not be found. Oct 24 08:55:26.492738 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:26.492738 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:26.492738 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:26.492738 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:26.492738 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:26.492738 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:26.492738 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:55:26.492738 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:55:26.492738 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:55:26.494994 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:55:26.494994 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:55:26.494994 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:55:26.494994 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:55:26.494994 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:55:26.494994 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:55:26.494994 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:55:26.494994 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 575d6bbd-9138-4599-8ffe-06b113b9ea99 could not be found. Oct 24 08:55:26.494994 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:26.494994 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:26.494994 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:26.494994 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:26.494994 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:26.494994 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:26.494994 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:55:26.494994 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:55:26.494994 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 575d6bbd-9138-4599-8ffe-06b113b9ea99 could not be found. Oct 24 08:55:26.494994 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:26.497882 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-e74f83e3-a8f8-44e7-8be3-a99a50049509 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Returning 404 to user: Instance 575d6bbd-9138-4599-8ffe-06b113b9ea99 could not be found. {{(pid=125164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:55:26.499205 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-e74f83e3-a8f8-44e7-8be3-a99a50049509 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99" status: 404 len: 111 microversion: 2.1 time: 0.046718 Oct 24 08:55:26.499870 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 421/839] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:26 2022] GET /compute/v2.1/servers/575d6bbd-9138-4599-8ffe-06b113b9ea99 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:55:27.359827 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-c5f00c36-6dfd-475d-89ac-6fbf3efa0fe8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:27.360926 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-c5f00c36-6dfd-475d-89ac-6fbf3efa0fe8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:27.372410 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c5f00c36-6dfd-475d-89ac-6fbf3efa0fe8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:27.374977 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c5f00c36-6dfd-475d-89ac-6fbf3efa0fe8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:27.375796 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c5f00c36-6dfd-475d-89ac-6fbf3efa0fe8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:27.378133 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c5f00c36-6dfd-475d-89ac-6fbf3efa0fe8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:27.378831 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c5f00c36-6dfd-475d-89ac-6fbf3efa0fe8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:27.381829 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-c5f00c36-6dfd-475d-89ac-6fbf3efa0fe8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:27.559761 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-c5f00c36-6dfd-475d-89ac-6fbf3efa0fe8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:27.585185 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-c5f00c36-6dfd-475d-89ac-6fbf3efa0fe8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:27.587180 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-c5f00c36-6dfd-475d-89ac-6fbf3efa0fe8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:27.588529 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-c5f00c36-6dfd-475d-89ac-6fbf3efa0fe8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1730 microversion: 2.20 time: 0.233572 Oct 24 08:55:27.596942 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 419/840] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:27 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1730 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:27.649227 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-6ab561a3-5a19-4e1e-891d-ad9088e9a5c4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:27.649863 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-6ab561a3-5a19-4e1e-891d-ad9088e9a5c4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:27.657353 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6ab561a3-5a19-4e1e-891d-ad9088e9a5c4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:27.657853 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6ab561a3-5a19-4e1e-891d-ad9088e9a5c4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:27.658291 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6ab561a3-5a19-4e1e-891d-ad9088e9a5c4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:27.659021 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6ab561a3-5a19-4e1e-891d-ad9088e9a5c4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:27.659478 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6ab561a3-5a19-4e1e-891d-ad9088e9a5c4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:27.659911 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6ab561a3-5a19-4e1e-891d-ad9088e9a5c4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:27.674781 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.wsgi [None req-6ab561a3-5a19-4e1e-891d-ad9088e9a5c4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] HTTP exception thrown: Instance 031a03be-3f3b-46dd-944c-6e68a9d8b09a could not be found. Oct 24 08:55:27.676337 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-6ab561a3-5a19-4e1e-891d-ad9088e9a5c4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Request method failure captured: Oct 24 08:55:27.676337 dv-cinder-master-3-smb devstack@n-api.service[125164]: request: DELETE /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a HTTP/1.1 Oct 24 08:55:27.676337 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept: application/json Oct 24 08:55:27.676337 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept-Encoding: identity Oct 24 08:55:27.676337 dv-cinder-master-3-smb devstack@n-api.service[125164]: Connection: close Oct 24 08:55:27.676337 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Length: 0 Oct 24 08:55:27.676337 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Type: application/json Oct 24 08:55:27.676337 dv-cinder-master-3-smb devstack@n-api.service[125164]: Host: 10.222.0.26 Oct 24 08:55:27.676337 dv-cinder-master-3-smb devstack@n-api.service[125164]: Openstack-System-Scope: None Oct 24 08:55:27.676337 dv-cinder-master-3-smb devstack@n-api.service[125164]: User-Agent: python-urllib3/1.26.12 Oct 24 08:55:27.676337 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Auth-Token: gAAAAABjVlEs7zvth7MHnGv5-srWFzIELY1EVJulvVew2aEj9f6LOenv6UXPx3kmL3jEMG7S0jyRtdGO2jKPLeRZ0c32ZGEq_aJAMtG02gWOFj_aMoKatwpYO1kkmmPd1CJABfG_8pAlpaUMho-e91opS3LwG_-hYLEPuoOd7BOJhPCD_r4uk_g Oct 24 08:55:27.676337 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Id: None Oct 24 08:55:27.676337 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Name: None Oct 24 08:55:27.676337 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Identity-Status: Confirmed Oct 24 08:55:27.676337 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Is-Admin-Project: True Oct 24 08:55:27.676337 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Id: default Oct 24 08:55:27.676337 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Name: Default Oct 24 08:55:27.676337 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Id: e3b77fd80fd84c29b4581fda1ff8cef9 Oct 24 08:55:27.676337 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Name: tempest-AttachVolumeTestJSON-292776923 Oct 24 08:55:27.676337 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Role: reader,member Oct 24 08:55:27.676337 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Roles: reader,member Oct 24 08:55:27.677989 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e3b77fd80fd84c29b4581fda1ff8cef9", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e3b77fd80fd84c29b4581fda1ff8cef9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e3b77fd80fd84c29b4581fda1ff8cef9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e3b77fd80fd84c29b4581fda1ff8cef9"}]}] Oct 24 08:55:27.677989 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant: tempest-AttachVolumeTestJSON-292776923 Oct 24 08:55:27.677989 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Id: e3b77fd80fd84c29b4581fda1ff8cef9 Oct 24 08:55:27.677989 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Name: tempest-AttachVolumeTestJSON-292776923 Oct 24 08:55:27.677989 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User: tempest-AttachVolumeTestJSON-292776923-project Oct 24 08:55:27.677989 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Id: default Oct 24 08:55:27.677989 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Name: Default Oct 24 08:55:27.677989 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Id: 7d793a1f26a3467ea8119e27e3394371 Oct 24 08:55:27.677989 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Name: tempest-AttachVolumeTestJSON-292776923-project Oct 24 08:55:27.677989 dv-cinder-master-3-smb devstack@n-api.service[125164]: method: > Oct 24 08:55:27.677989 dv-cinder-master-3-smb devstack@n-api.service[125164]: exception: Instance 031a03be-3f3b-46dd-944c-6e68a9d8b09a could not be found. Oct 24 08:55:27.677989 dv-cinder-master-3-smb devstack@n-api.service[125164]: action_args: {'id': '031a03be-3f3b-46dd-944c-6e68a9d8b09a'} Oct 24 08:55:27.678858 dv-cinder-master-3-smb devstack@n-api.service[125164]: {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:55:27.678858 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:27.678858 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:55:27.678858 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:55:27.678858 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:55:27.678858 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:55:27.678858 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:55:27.678858 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:55:27.678858 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:55:27.678858 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:55:27.678858 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 031a03be-3f3b-46dd-944c-6e68a9d8b09a could not be found. Oct 24 08:55:27.678858 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:27.678858 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:27.678858 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:27.678858 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:27.678858 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:27.678858 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:27.678858 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:55:27.678858 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:55:27.678858 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:55:27.680159 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:55:27.680159 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 08:55:27.680159 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 08:55:27.680159 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 08:55:27.680159 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 08:55:27.680159 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:55:27.680159 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:55:27.680159 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:55:27.680159 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:55:27.680159 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 031a03be-3f3b-46dd-944c-6e68a9d8b09a could not be found. Oct 24 08:55:27.680159 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:27.680159 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:27.680159 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:27.680159 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:27.680159 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:27.680159 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:27.680159 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:55:27.680159 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:55:27.680159 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 031a03be-3f3b-46dd-944c-6e68a9d8b09a could not be found. Oct 24 08:55:27.680159 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:27.681422 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-6ab561a3-5a19-4e1e-891d-ad9088e9a5c4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Returning 404 to user: Instance 031a03be-3f3b-46dd-944c-6e68a9d8b09a could not be found. {{(pid=125164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:55:27.681422 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-6ab561a3-5a19-4e1e-891d-ad9088e9a5c4 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "DELETE /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 404 len: 111 microversion: 2.1 time: 0.032544 Oct 24 08:55:27.681422 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 422/841] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Oct 24 08:55:27 2022] DELETE /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:55:27.686915 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-b2ad52a2-55d6-4314-a411-1e33cf0ae0f6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:27.687551 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-b2ad52a2-55d6-4314-a411-1e33cf0ae0f6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] [instance: 031a03be-3f3b-46dd-944c-6e68a9d8b09a] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:27.693492 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b2ad52a2-55d6-4314-a411-1e33cf0ae0f6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:27.693972 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b2ad52a2-55d6-4314-a411-1e33cf0ae0f6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:27.694413 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b2ad52a2-55d6-4314-a411-1e33cf0ae0f6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:27.695141 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b2ad52a2-55d6-4314-a411-1e33cf0ae0f6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:27.695602 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b2ad52a2-55d6-4314-a411-1e33cf0ae0f6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:27.696025 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b2ad52a2-55d6-4314-a411-1e33cf0ae0f6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:27.709350 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.wsgi [None req-b2ad52a2-55d6-4314-a411-1e33cf0ae0f6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] HTTP exception thrown: Instance 031a03be-3f3b-46dd-944c-6e68a9d8b09a could not be found. Oct 24 08:55:27.710909 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-b2ad52a2-55d6-4314-a411-1e33cf0ae0f6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Request method failure captured: Oct 24 08:55:27.710909 dv-cinder-master-3-smb devstack@n-api.service[125165]: request: GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a HTTP/1.1 Oct 24 08:55:27.710909 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept: application/json Oct 24 08:55:27.710909 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept-Encoding: identity Oct 24 08:55:27.710909 dv-cinder-master-3-smb devstack@n-api.service[125165]: Connection: close Oct 24 08:55:27.710909 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Length: 0 Oct 24 08:55:27.710909 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Type: application/json Oct 24 08:55:27.710909 dv-cinder-master-3-smb devstack@n-api.service[125165]: Host: 10.222.0.26 Oct 24 08:55:27.710909 dv-cinder-master-3-smb devstack@n-api.service[125165]: Openstack-System-Scope: None Oct 24 08:55:27.710909 dv-cinder-master-3-smb devstack@n-api.service[125165]: User-Agent: python-urllib3/1.26.12 Oct 24 08:55:27.710909 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Auth-Token: gAAAAABjVlEs7zvth7MHnGv5-srWFzIELY1EVJulvVew2aEj9f6LOenv6UXPx3kmL3jEMG7S0jyRtdGO2jKPLeRZ0c32ZGEq_aJAMtG02gWOFj_aMoKatwpYO1kkmmPd1CJABfG_8pAlpaUMho-e91opS3LwG_-hYLEPuoOd7BOJhPCD_r4uk_g Oct 24 08:55:27.710909 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Id: None Oct 24 08:55:27.710909 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Name: None Oct 24 08:55:27.710909 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Identity-Status: Confirmed Oct 24 08:55:27.710909 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Is-Admin-Project: True Oct 24 08:55:27.710909 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Id: default Oct 24 08:55:27.710909 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Name: Default Oct 24 08:55:27.710909 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Id: e3b77fd80fd84c29b4581fda1ff8cef9 Oct 24 08:55:27.710909 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Name: tempest-AttachVolumeTestJSON-292776923 Oct 24 08:55:27.710909 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Role: reader,member Oct 24 08:55:27.710909 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Roles: reader,member Oct 24 08:55:27.712436 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e3b77fd80fd84c29b4581fda1ff8cef9", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e3b77fd80fd84c29b4581fda1ff8cef9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e3b77fd80fd84c29b4581fda1ff8cef9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e3b77fd80fd84c29b4581fda1ff8cef9"}]}] Oct 24 08:55:27.712436 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant: tempest-AttachVolumeTestJSON-292776923 Oct 24 08:55:27.712436 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Id: e3b77fd80fd84c29b4581fda1ff8cef9 Oct 24 08:55:27.712436 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Name: tempest-AttachVolumeTestJSON-292776923 Oct 24 08:55:27.712436 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User: tempest-AttachVolumeTestJSON-292776923-project Oct 24 08:55:27.712436 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Id: default Oct 24 08:55:27.712436 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Name: Default Oct 24 08:55:27.712436 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Id: 7d793a1f26a3467ea8119e27e3394371 Oct 24 08:55:27.712436 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Name: tempest-AttachVolumeTestJSON-292776923-project Oct 24 08:55:27.712436 dv-cinder-master-3-smb devstack@n-api.service[125165]: method: > Oct 24 08:55:27.712436 dv-cinder-master-3-smb devstack@n-api.service[125165]: exception: Instance 031a03be-3f3b-46dd-944c-6e68a9d8b09a could not be found. Oct 24 08:55:27.712436 dv-cinder-master-3-smb devstack@n-api.service[125165]: action_args: {'id': '031a03be-3f3b-46dd-944c-6e68a9d8b09a'} Oct 24 08:55:27.713329 dv-cinder-master-3-smb devstack@n-api.service[125165]: {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:55:27.713329 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:27.713329 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:55:27.713329 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:55:27.713329 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:55:27.713329 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:55:27.713329 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:55:27.713329 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:55:27.713329 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:55:27.713329 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:55:27.713329 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 031a03be-3f3b-46dd-944c-6e68a9d8b09a could not be found. Oct 24 08:55:27.713329 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:55:27.713329 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:27.713329 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:55:27.713329 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:27.713329 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:27.713329 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:27.713329 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:55:27.713329 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:55:27.713329 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:55:27.714838 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:55:27.714838 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:55:27.714838 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:55:27.714838 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:55:27.714838 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:55:27.714838 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:55:27.714838 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:55:27.714838 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 031a03be-3f3b-46dd-944c-6e68a9d8b09a could not be found. Oct 24 08:55:27.714838 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:55:27.714838 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:27.714838 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:55:27.714838 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:27.714838 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:27.714838 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:27.714838 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:55:27.714838 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:55:27.714838 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 031a03be-3f3b-46dd-944c-6e68a9d8b09a could not be found. Oct 24 08:55:27.714838 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:55:27.716169 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-b2ad52a2-55d6-4314-a411-1e33cf0ae0f6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] Returning 404 to user: Instance 031a03be-3f3b-46dd-944c-6e68a9d8b09a could not be found. {{(pid=125165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:55:27.716169 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-b2ad52a2-55d6-4314-a411-1e33cf0ae0f6 tempest-AttachVolumeTestJSON-292776923 tempest-AttachVolumeTestJSON-292776923-project] 10.222.0.26 "GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a" status: 404 len: 111 microversion: 2.1 time: 0.029428 Oct 24 08:55:27.716169 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 420/842] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:55:27 2022] GET /compute/v2.1/servers/031a03be-3f3b-46dd-944c-6e68a9d8b09a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 08:55:28.616994 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-48d68221-999c-41c0-8461-6538f4d12ebe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:28.618163 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-48d68221-999c-41c0-8461-6538f4d12ebe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:28.633468 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-48d68221-999c-41c0-8461-6538f4d12ebe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:28.634672 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-48d68221-999c-41c0-8461-6538f4d12ebe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:28.636828 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-48d68221-999c-41c0-8461-6538f4d12ebe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:28.639237 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-48d68221-999c-41c0-8461-6538f4d12ebe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:28.640068 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-48d68221-999c-41c0-8461-6538f4d12ebe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:28.641303 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-48d68221-999c-41c0-8461-6538f4d12ebe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:28.979296 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-48d68221-999c-41c0-8461-6538f4d12ebe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:28.987996 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-48d68221-999c-41c0-8461-6538f4d12ebe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:28.989546 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-48d68221-999c-41c0-8461-6538f4d12ebe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:28.990971 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-48d68221-999c-41c0-8461-6538f4d12ebe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1730 microversion: 2.20 time: 0.378931 Oct 24 08:55:29.006559 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 423/843] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:28 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1730 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:30.016620 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-65906120-6d16-4a2d-a95b-75cc1b1a9fb8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:30.017552 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-65906120-6d16-4a2d-a95b-75cc1b1a9fb8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:30.025329 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-65906120-6d16-4a2d-a95b-75cc1b1a9fb8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:30.025840 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-65906120-6d16-4a2d-a95b-75cc1b1a9fb8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:30.026284 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-65906120-6d16-4a2d-a95b-75cc1b1a9fb8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:30.031224 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-65906120-6d16-4a2d-a95b-75cc1b1a9fb8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:30.031797 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-65906120-6d16-4a2d-a95b-75cc1b1a9fb8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:30.032245 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-65906120-6d16-4a2d-a95b-75cc1b1a9fb8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:30.182669 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-65906120-6d16-4a2d-a95b-75cc1b1a9fb8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:30.193008 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-65906120-6d16-4a2d-a95b-75cc1b1a9fb8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:30.194468 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-65906120-6d16-4a2d-a95b-75cc1b1a9fb8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:30.195733 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-65906120-6d16-4a2d-a95b-75cc1b1a9fb8 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1730 microversion: 2.20 time: 0.183627 Oct 24 08:55:30.196617 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 421/844] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:30 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:31.225908 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-f8575f02-7fae-4e6a-9659-e11ad3139925 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:31.226761 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-f8575f02-7fae-4e6a-9659-e11ad3139925 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:31.230283 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:31.244074 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f8575f02-7fae-4e6a-9659-e11ad3139925 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:31.247039 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f8575f02-7fae-4e6a-9659-e11ad3139925 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:31.247885 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f8575f02-7fae-4e6a-9659-e11ad3139925 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:31.248992 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f8575f02-7fae-4e6a-9659-e11ad3139925 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:31.249446 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f8575f02-7fae-4e6a-9659-e11ad3139925 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:31.251145 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-f8575f02-7fae-4e6a-9659-e11ad3139925 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:31.594312 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-f8575f02-7fae-4e6a-9659-e11ad3139925 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:31.605098 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-f8575f02-7fae-4e6a-9659-e11ad3139925 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:31.607830 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-f8575f02-7fae-4e6a-9659-e11ad3139925 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:31.609451 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-f8575f02-7fae-4e6a-9659-e11ad3139925 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1730 microversion: 2.20 time: 0.389757 Oct 24 08:55:31.610685 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 424/845] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:31 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1730 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:32.638343 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-55112253-8965-4e67-ac8b-e0c00ff4a14a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:32.638930 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-55112253-8965-4e67-ac8b-e0c00ff4a14a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:32.669293 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-55112253-8965-4e67-ac8b-e0c00ff4a14a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:32.671232 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-55112253-8965-4e67-ac8b-e0c00ff4a14a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:32.672863 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-55112253-8965-4e67-ac8b-e0c00ff4a14a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:32.674669 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-55112253-8965-4e67-ac8b-e0c00ff4a14a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:32.675861 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-55112253-8965-4e67-ac8b-e0c00ff4a14a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:32.676989 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-55112253-8965-4e67-ac8b-e0c00ff4a14a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:32.965727 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-55112253-8965-4e67-ac8b-e0c00ff4a14a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:32.975018 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-55112253-8965-4e67-ac8b-e0c00ff4a14a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:32.976563 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-55112253-8965-4e67-ac8b-e0c00ff4a14a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:32.978380 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-55112253-8965-4e67-ac8b-e0c00ff4a14a tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1730 microversion: 2.20 time: 0.344011 Oct 24 08:55:32.979297 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 422/846] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:32 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1730 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:33.994446 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-18fedfe1-a6c0-44e1-9bb4-6c04e572a492 tempest-VolumesNegativeTest-1425167617 tempest-VolumesNegativeTest-1425167617-project] Action: 'create', calling method: .version_select at 0x7f7ef16f4d30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-402761719", "metadata": {"Type": "work"}}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:55:34.006239 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-18fedfe1-a6c0-44e1-9bb4-6c04e572a492 tempest-VolumesNegativeTest-1425167617 tempest-VolumesNegativeTest-1425167617-project] Request method failure captured: Oct 24 08:55:34.006239 dv-cinder-master-3-smb devstack@n-api.service[125164]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 24 08:55:34.006239 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept: application/json Oct 24 08:55:34.006239 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept-Encoding: identity Oct 24 08:55:34.006239 dv-cinder-master-3-smb devstack@n-api.service[125164]: Connection: close Oct 24 08:55:34.006239 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Length: 121 Oct 24 08:55:34.006239 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Type: application/json Oct 24 08:55:34.006239 dv-cinder-master-3-smb devstack@n-api.service[125164]: Host: 10.222.0.26 Oct 24 08:55:34.006239 dv-cinder-master-3-smb devstack@n-api.service[125164]: Openstack-System-Scope: None Oct 24 08:55:34.006239 dv-cinder-master-3-smb devstack@n-api.service[125164]: User-Agent: python-urllib3/1.26.12 Oct 24 08:55:34.006239 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Auth-Token: gAAAAABjVlMFT9aCkUA50VglhjdNsfGMY8T98TgV2nF2rdVWqRGHLc1obSg4_JKJEGPiMR3fZbxUILQLNXsVr2sQ3rxtmMmGgjiRs9hF0WfMelfcQ8Bwiocji9rarALAAQ8eQEywnwTECJ4xnxNlmCccL-zOzNiUnA69pe6KwBkQLNVTm_zm1p0 Oct 24 08:55:34.006239 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Id: None Oct 24 08:55:34.006239 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Name: None Oct 24 08:55:34.006239 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Identity-Status: Confirmed Oct 24 08:55:34.006239 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Is-Admin-Project: True Oct 24 08:55:34.006239 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Id: default Oct 24 08:55:34.006239 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Name: Default Oct 24 08:55:34.006239 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Id: ff59dc49e8a945d3936f85d58c49774e Oct 24 08:55:34.006239 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Name: tempest-VolumesNegativeTest-1425167617 Oct 24 08:55:34.006239 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Role: reader,member Oct 24 08:55:34.006239 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Roles: reader,member Oct 24 08:55:34.007695 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ff59dc49e8a945d3936f85d58c49774e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ff59dc49e8a945d3936f85d58c49774e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ff59dc49e8a945d3936f85d58c49774e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ff59dc49e8a945d3936f85d58c49774e"}]}] Oct 24 08:55:34.007695 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant: tempest-VolumesNegativeTest-1425167617 Oct 24 08:55:34.007695 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Id: ff59dc49e8a945d3936f85d58c49774e Oct 24 08:55:34.007695 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Name: tempest-VolumesNegativeTest-1425167617 Oct 24 08:55:34.007695 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User: tempest-VolumesNegativeTest-1425167617-project Oct 24 08:55:34.007695 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Id: default Oct 24 08:55:34.007695 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Name: Default Oct 24 08:55:34.007695 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Id: 8b7cf0929a9c433ebde5a292a8f0f518 Oct 24 08:55:34.007695 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Name: tempest-VolumesNegativeTest-1425167617-project Oct 24 08:55:34.007695 dv-cinder-master-3-smb devstack@n-api.service[125164]: Oct 24 08:55:34.007695 dv-cinder-master-3-smb devstack@n-api.service[125164]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-402761719", "metadata": {"Type": "work"}}} Oct 24 08:55:34.007695 dv-cinder-master-3-smb devstack@n-api.service[125164]: method: Oct 24 08:55:34.007695 dv-cinder-master-3-smb devstack@n-api.service[125164]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 24 08:55:34.008605 dv-cinder-master-3-smb devstack@n-api.service[125164]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-402761719', 'metadata': {'Type': 'work'}}}} Oct 24 08:55:34.008605 dv-cinder-master-3-smb devstack@n-api.service[125164]: {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:55:34.008605 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:34.008605 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 08:55:34.008605 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 08:55:34.008605 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 08:55:34.008605 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise error Oct 24 08:55:34.008605 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 24 08:55:34.008605 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.008605 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 24 08:55:34.008605 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 24 08:55:34.008605 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.008605 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 24 08:55:34.008605 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi '#$%' Oct 24 08:55:34.008605 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.008605 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:34.008605 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.008605 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:34.008605 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:34.008605 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:34.008605 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:55:34.008605 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:55:34.010100 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:55:34.010100 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:55:34.010100 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:55:34.010100 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:55:34.010100 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 08:55:34.010100 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 08:55:34.010100 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 08:55:34.010100 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 08:55:34.010100 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 08:55:34.010100 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 08:55:34.010100 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 24 08:55:34.010100 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.010100 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:34.010100 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.010100 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:34.010100 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:34.010100 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:34.010100 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 08:55:34.010100 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 08:55:34.013089 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 24 08:55:34.013089 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.013407 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-98b506f9-60b6-44bc-8b15-24c80dddfe06 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:34.013888 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-18fedfe1-a6c0-44e1-9bb4-6c04e572a492 tempest-VolumesNegativeTest-1425167617 tempest-VolumesNegativeTest-1425167617-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=125164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:55:34.014045 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-98b506f9-60b6-44bc-8b15-24c80dddfe06 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:34.014202 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-18fedfe1-a6c0-44e1-9bb4-6c04e572a492 tempest-VolumesNegativeTest-1425167617 tempest-VolumesNegativeTest-1425167617-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.272451 Oct 24 08:55:34.014202 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 425/847] 10.222.0.26 () {60 vars in 1156 bytes} [Mon Oct 24 08:55:33 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 274 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 24 08:55:34.014515 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-98b506f9-60b6-44bc-8b15-24c80dddfe06 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:34.014672 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-98b506f9-60b6-44bc-8b15-24c80dddfe06 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:34.015256 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-98b506f9-60b6-44bc-8b15-24c80dddfe06 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:34.015961 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-98b506f9-60b6-44bc-8b15-24c80dddfe06 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:34.016399 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-98b506f9-60b6-44bc-8b15-24c80dddfe06 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:34.016824 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-98b506f9-60b6-44bc-8b15-24c80dddfe06 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:34.020263 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-5dec68be-0c9d-4fd9-b683-aabac1d213d9 tempest-VolumesNegativeTest-1425167617 tempest-VolumesNegativeTest-1425167617-project] Action: 'create', calling method: .version_select at 0x7f7ef1783af0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1722245079", "metadata": {"Type": "work"}}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:55:34.025791 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-5dec68be-0c9d-4fd9-b683-aabac1d213d9 tempest-VolumesNegativeTest-1425167617 tempest-VolumesNegativeTest-1425167617-project] Request method failure captured: Oct 24 08:55:34.025791 dv-cinder-master-3-smb devstack@n-api.service[125164]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 24 08:55:34.025791 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept: application/json Oct 24 08:55:34.025791 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept-Encoding: identity Oct 24 08:55:34.025791 dv-cinder-master-3-smb devstack@n-api.service[125164]: Connection: close Oct 24 08:55:34.025791 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Length: 120 Oct 24 08:55:34.025791 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Type: application/json Oct 24 08:55:34.025791 dv-cinder-master-3-smb devstack@n-api.service[125164]: Host: 10.222.0.26 Oct 24 08:55:34.025791 dv-cinder-master-3-smb devstack@n-api.service[125164]: Openstack-System-Scope: None Oct 24 08:55:34.025791 dv-cinder-master-3-smb devstack@n-api.service[125164]: User-Agent: python-urllib3/1.26.12 Oct 24 08:55:34.025791 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Auth-Token: gAAAAABjVlMFT9aCkUA50VglhjdNsfGMY8T98TgV2nF2rdVWqRGHLc1obSg4_JKJEGPiMR3fZbxUILQLNXsVr2sQ3rxtmMmGgjiRs9hF0WfMelfcQ8Bwiocji9rarALAAQ8eQEywnwTECJ4xnxNlmCccL-zOzNiUnA69pe6KwBkQLNVTm_zm1p0 Oct 24 08:55:34.025791 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Id: None Oct 24 08:55:34.025791 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Name: None Oct 24 08:55:34.025791 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Identity-Status: Confirmed Oct 24 08:55:34.025791 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Is-Admin-Project: True Oct 24 08:55:34.025791 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Id: default Oct 24 08:55:34.025791 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Name: Default Oct 24 08:55:34.025791 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Id: ff59dc49e8a945d3936f85d58c49774e Oct 24 08:55:34.025791 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Name: tempest-VolumesNegativeTest-1425167617 Oct 24 08:55:34.025791 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Role: reader,member Oct 24 08:55:34.025791 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Roles: reader,member Oct 24 08:55:34.027613 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ff59dc49e8a945d3936f85d58c49774e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ff59dc49e8a945d3936f85d58c49774e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ff59dc49e8a945d3936f85d58c49774e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ff59dc49e8a945d3936f85d58c49774e"}]}] Oct 24 08:55:34.027613 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant: tempest-VolumesNegativeTest-1425167617 Oct 24 08:55:34.027613 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Id: ff59dc49e8a945d3936f85d58c49774e Oct 24 08:55:34.027613 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Name: tempest-VolumesNegativeTest-1425167617 Oct 24 08:55:34.027613 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User: tempest-VolumesNegativeTest-1425167617-project Oct 24 08:55:34.027613 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Id: default Oct 24 08:55:34.027613 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Name: Default Oct 24 08:55:34.027613 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Id: 8b7cf0929a9c433ebde5a292a8f0f518 Oct 24 08:55:34.027613 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Name: tempest-VolumesNegativeTest-1425167617-project Oct 24 08:55:34.027613 dv-cinder-master-3-smb devstack@n-api.service[125164]: Oct 24 08:55:34.027613 dv-cinder-master-3-smb devstack@n-api.service[125164]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1722245079", "metadata": {"Type": "work"}}} Oct 24 08:55:34.027613 dv-cinder-master-3-smb devstack@n-api.service[125164]: method: Oct 24 08:55:34.027613 dv-cinder-master-3-smb devstack@n-api.service[125164]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 24 08:55:34.029002 dv-cinder-master-3-smb devstack@n-api.service[125164]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1722245079', 'metadata': {'Type': 'work'}}}} Oct 24 08:55:34.029002 dv-cinder-master-3-smb devstack@n-api.service[125164]: {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:55:34.029002 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:34.029002 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 08:55:34.029002 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 08:55:34.029002 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 08:55:34.029002 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise error Oct 24 08:55:34.029002 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 24 08:55:34.029002 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.029002 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 24 08:55:34.029002 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 24 08:55:34.029002 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.029002 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 24 08:55:34.029002 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi '0' Oct 24 08:55:34.029002 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.029002 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:34.029002 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.029002 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:34.029002 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:34.029002 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:34.029002 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:55:34.029002 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:55:34.032047 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:55:34.032047 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:55:34.032047 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:55:34.032047 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:55:34.032047 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 08:55:34.032047 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 08:55:34.032047 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 08:55:34.032047 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 08:55:34.032047 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 08:55:34.032047 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 08:55:34.032047 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 24 08:55:34.032047 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.032047 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:34.032047 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.032047 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:34.032047 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:34.032047 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:34.032047 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 08:55:34.032047 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 08:55:34.034903 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 24 08:55:34.034903 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.034903 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-5dec68be-0c9d-4fd9-b683-aabac1d213d9 tempest-VolumesNegativeTest-1425167617 tempest-VolumesNegativeTest-1425167617-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=125164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:55:34.034903 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-5dec68be-0c9d-4fd9-b683-aabac1d213d9 tempest-VolumesNegativeTest-1425167617 tempest-VolumesNegativeTest-1425167617-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012154 Oct 24 08:55:34.034903 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 426/848] 10.222.0.26 () {60 vars in 1156 bytes} [Mon Oct 24 08:55:34 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 08:55:34.040156 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-a641b21b-2348-4f42-9f69-a5ac5702e6c2 tempest-VolumesNegativeTest-1425167617 tempest-VolumesNegativeTest-1425167617-project] Action: 'create', calling method: .version_select at 0x7f7ef15d9d30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-633979976", "metadata": {"Type": "work"}}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:55:34.043844 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-a641b21b-2348-4f42-9f69-a5ac5702e6c2 tempest-VolumesNegativeTest-1425167617 tempest-VolumesNegativeTest-1425167617-project] Request method failure captured: Oct 24 08:55:34.043844 dv-cinder-master-3-smb devstack@n-api.service[125164]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 24 08:55:34.043844 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept: application/json Oct 24 08:55:34.043844 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept-Encoding: identity Oct 24 08:55:34.043844 dv-cinder-master-3-smb devstack@n-api.service[125164]: Connection: close Oct 24 08:55:34.043844 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Length: 118 Oct 24 08:55:34.043844 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Type: application/json Oct 24 08:55:34.043844 dv-cinder-master-3-smb devstack@n-api.service[125164]: Host: 10.222.0.26 Oct 24 08:55:34.043844 dv-cinder-master-3-smb devstack@n-api.service[125164]: Openstack-System-Scope: None Oct 24 08:55:34.043844 dv-cinder-master-3-smb devstack@n-api.service[125164]: User-Agent: python-urllib3/1.26.12 Oct 24 08:55:34.043844 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Auth-Token: gAAAAABjVlMFT9aCkUA50VglhjdNsfGMY8T98TgV2nF2rdVWqRGHLc1obSg4_JKJEGPiMR3fZbxUILQLNXsVr2sQ3rxtmMmGgjiRs9hF0WfMelfcQ8Bwiocji9rarALAAQ8eQEywnwTECJ4xnxNlmCccL-zOzNiUnA69pe6KwBkQLNVTm_zm1p0 Oct 24 08:55:34.043844 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Id: None Oct 24 08:55:34.043844 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Name: None Oct 24 08:55:34.043844 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Identity-Status: Confirmed Oct 24 08:55:34.043844 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Is-Admin-Project: True Oct 24 08:55:34.043844 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Id: default Oct 24 08:55:34.043844 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Name: Default Oct 24 08:55:34.043844 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Id: ff59dc49e8a945d3936f85d58c49774e Oct 24 08:55:34.043844 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Name: tempest-VolumesNegativeTest-1425167617 Oct 24 08:55:34.043844 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Role: reader,member Oct 24 08:55:34.043844 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Roles: reader,member Oct 24 08:55:34.046406 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ff59dc49e8a945d3936f85d58c49774e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ff59dc49e8a945d3936f85d58c49774e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ff59dc49e8a945d3936f85d58c49774e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ff59dc49e8a945d3936f85d58c49774e"}]}] Oct 24 08:55:34.046406 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant: tempest-VolumesNegativeTest-1425167617 Oct 24 08:55:34.046406 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Id: ff59dc49e8a945d3936f85d58c49774e Oct 24 08:55:34.046406 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Name: tempest-VolumesNegativeTest-1425167617 Oct 24 08:55:34.046406 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User: tempest-VolumesNegativeTest-1425167617-project Oct 24 08:55:34.046406 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Id: default Oct 24 08:55:34.046406 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Name: Default Oct 24 08:55:34.046406 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Id: 8b7cf0929a9c433ebde5a292a8f0f518 Oct 24 08:55:34.046406 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Name: tempest-VolumesNegativeTest-1425167617-project Oct 24 08:55:34.046406 dv-cinder-master-3-smb devstack@n-api.service[125164]: Oct 24 08:55:34.046406 dv-cinder-master-3-smb devstack@n-api.service[125164]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-633979976", "metadata": {"Type": "work"}}} Oct 24 08:55:34.046406 dv-cinder-master-3-smb devstack@n-api.service[125164]: method: Oct 24 08:55:34.046406 dv-cinder-master-3-smb devstack@n-api.service[125164]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 24 08:55:34.048574 dv-cinder-master-3-smb devstack@n-api.service[125164]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-633979976', 'metadata': {'Type': 'work'}}}} Oct 24 08:55:34.048574 dv-cinder-master-3-smb devstack@n-api.service[125164]: {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:55:34.048574 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:34.048574 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 08:55:34.048574 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 08:55:34.048574 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 08:55:34.048574 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise error Oct 24 08:55:34.048574 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 24 08:55:34.048574 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.048574 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 24 08:55:34.048574 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 24 08:55:34.048574 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.048574 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 24 08:55:34.048574 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi '' Oct 24 08:55:34.048574 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.048574 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:34.048574 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.048574 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:34.048574 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:34.048574 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:34.048574 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:55:34.048574 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:55:34.052716 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:55:34.052716 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:55:34.052716 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:55:34.052716 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:55:34.052716 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 08:55:34.052716 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 08:55:34.052716 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 08:55:34.052716 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 08:55:34.052716 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 08:55:34.052716 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 08:55:34.052716 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 24 08:55:34.052716 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.052716 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:34.052716 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.052716 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:34.052716 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:34.052716 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:34.052716 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 08:55:34.052716 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 08:55:34.054331 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 24 08:55:34.054331 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.054331 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-a641b21b-2348-4f42-9f69-a5ac5702e6c2 tempest-VolumesNegativeTest-1425167617 tempest-VolumesNegativeTest-1425167617-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=125164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:55:34.054331 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-a641b21b-2348-4f42-9f69-a5ac5702e6c2 tempest-VolumesNegativeTest-1425167617 tempest-VolumesNegativeTest-1425167617-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009503 Oct 24 08:55:34.054331 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 427/849] 10.222.0.26 () {60 vars in 1156 bytes} [Mon Oct 24 08:55:34 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 08:55:34.057853 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-78101744-b36a-4f85-a554-2f597d7c6ecd tempest-VolumesNegativeTest-1425167617 tempest-VolumesNegativeTest-1425167617-project] Calling method '.version_select at 0x7f7ef15ec310>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:34.088628 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.wsgi [None req-78101744-b36a-4f85-a554-2f597d7c6ecd tempest-VolumesNegativeTest-1425167617 tempest-VolumesNegativeTest-1425167617-project] HTTP exception thrown: Volume tempest-invalid-1711720170 could not be found. Oct 24 08:55:34.094422 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-78101744-b36a-4f85-a554-2f597d7c6ecd tempest-VolumesNegativeTest-1425167617 tempest-VolumesNegativeTest-1425167617-project] Request method failure captured: Oct 24 08:55:34.094422 dv-cinder-master-3-smb devstack@n-api.service[125164]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1711720170 HTTP/1.1 Oct 24 08:55:34.094422 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept: application/json Oct 24 08:55:34.094422 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept-Encoding: identity Oct 24 08:55:34.094422 dv-cinder-master-3-smb devstack@n-api.service[125164]: Connection: close Oct 24 08:55:34.094422 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Length: 0 Oct 24 08:55:34.094422 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Type: application/json Oct 24 08:55:34.094422 dv-cinder-master-3-smb devstack@n-api.service[125164]: Host: 10.222.0.26 Oct 24 08:55:34.094422 dv-cinder-master-3-smb devstack@n-api.service[125164]: Openstack-System-Scope: None Oct 24 08:55:34.094422 dv-cinder-master-3-smb devstack@n-api.service[125164]: User-Agent: python-urllib3/1.26.12 Oct 24 08:55:34.094422 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Auth-Token: gAAAAABjVlMFT9aCkUA50VglhjdNsfGMY8T98TgV2nF2rdVWqRGHLc1obSg4_JKJEGPiMR3fZbxUILQLNXsVr2sQ3rxtmMmGgjiRs9hF0WfMelfcQ8Bwiocji9rarALAAQ8eQEywnwTECJ4xnxNlmCccL-zOzNiUnA69pe6KwBkQLNVTm_zm1p0 Oct 24 08:55:34.094422 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Id: None Oct 24 08:55:34.094422 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Name: None Oct 24 08:55:34.094422 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Identity-Status: Confirmed Oct 24 08:55:34.094422 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Is-Admin-Project: True Oct 24 08:55:34.094422 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Id: default Oct 24 08:55:34.094422 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Name: Default Oct 24 08:55:34.094422 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Id: ff59dc49e8a945d3936f85d58c49774e Oct 24 08:55:34.094422 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Name: tempest-VolumesNegativeTest-1425167617 Oct 24 08:55:34.094422 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Role: reader,member Oct 24 08:55:34.094422 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Roles: reader,member Oct 24 08:55:34.096103 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ff59dc49e8a945d3936f85d58c49774e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ff59dc49e8a945d3936f85d58c49774e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ff59dc49e8a945d3936f85d58c49774e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ff59dc49e8a945d3936f85d58c49774e"}]}] Oct 24 08:55:34.096103 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant: tempest-VolumesNegativeTest-1425167617 Oct 24 08:55:34.096103 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Id: ff59dc49e8a945d3936f85d58c49774e Oct 24 08:55:34.096103 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Name: tempest-VolumesNegativeTest-1425167617 Oct 24 08:55:34.096103 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User: tempest-VolumesNegativeTest-1425167617-project Oct 24 08:55:34.096103 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Id: default Oct 24 08:55:34.096103 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Name: Default Oct 24 08:55:34.096103 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Id: 8b7cf0929a9c433ebde5a292a8f0f518 Oct 24 08:55:34.096103 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Name: tempest-VolumesNegativeTest-1425167617-project Oct 24 08:55:34.096103 dv-cinder-master-3-smb devstack@n-api.service[125164]: method: Oct 24 08:55:34.096103 dv-cinder-master-3-smb devstack@n-api.service[125164]: exception: Volume tempest-invalid-1711720170 could not be found. Oct 24 08:55:34.096103 dv-cinder-master-3-smb devstack@n-api.service[125164]: action_args: {'id': 'tempest-invalid-1711720170'} Oct 24 08:55:34.096103 dv-cinder-master-3-smb devstack@n-api.service[125164]: {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:55:34.097104 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:34.097104 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 08:55:34.097104 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 08:55:34.097104 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 24 08:55:34.097104 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 24 08:55:34.097104 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 24 08:55:34.097104 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 24 08:55:34.097104 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 24 08:55:34.097104 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 24 08:55:34.097104 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 24 08:55:34.097104 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 24 08:55:34.097104 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 08:55:34.097104 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 08:55:34.097104 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 08:55:34.097104 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 08:55:34.097104 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1711720170 could not be found. (HTTP 404) (Request-ID: req-1b8bef9d-d8dd-4e3c-8885-ede68a4d903d) Oct 24 08:55:34.097104 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.097104 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:34.097104 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.098642 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:34.098642 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 24 08:55:34.098642 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 24 08:55:34.098642 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 08:55:34.098642 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 08:55:34.098642 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 08:55:34.098642 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 08:55:34.098642 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 08:55:34.098642 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 08:55:34.098642 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 08:55:34.098642 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 08:55:34.098642 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 24 08:55:34.098642 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 24 08:55:34.098642 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 24 08:55:34.098642 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 24 08:55:34.098642 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 24 08:55:34.098642 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 24 08:55:34.098642 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 24 08:55:34.098642 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 24 08:55:34.100200 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 08:55:34.100200 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 08:55:34.100200 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 08:55:34.100200 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 08:55:34.100200 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1711720170 could not be found. Oct 24 08:55:34.100200 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.100200 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:34.100200 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.100200 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:34.100200 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:34.100200 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:34.100200 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:55:34.100200 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:55:34.100200 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:55:34.100200 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:55:34.100200 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:55:34.100200 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:55:34.100200 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 24 08:55:34.100200 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:55:34.100200 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1711720170 could not be found. Oct 24 08:55:34.101579 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.101579 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:34.101579 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.101579 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:34.101579 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:34.101579 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:34.101579 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:55:34.101579 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:55:34.101579 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1711720170 could not be found. Oct 24 08:55:34.101579 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.101579 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-78101744-b36a-4f85-a554-2f597d7c6ecd tempest-VolumesNegativeTest-1425167617 tempest-VolumesNegativeTest-1425167617-project] Returning 404 to user: Volume tempest-invalid-1711720170 could not be found. {{(pid=125164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:55:34.101579 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-78101744-b36a-4f85-a554-2f597d7c6ecd tempest-VolumesNegativeTest-1425167617 tempest-VolumesNegativeTest-1425167617-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1711720170" status: 404 len: 99 microversion: 2.1 time: 0.042601 Oct 24 08:55:34.101579 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 428/850] 10.222.0.26 () {58 vars in 1218 bytes} [Mon Oct 24 08:55:34 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1711720170 => generated 99 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 08:55:34.108493 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-531d4e4e-6d30-4277-9531-d1597a5c2c7a tempest-VolumesNegativeTest-1425167617 tempest-VolumesNegativeTest-1425167617-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003773 Oct 24 08:55:34.108996 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 429/851] 10.222.0.26 () {58 vars in 1140 bytes} [Mon Oct 24 08:55:34 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 24 08:55:34.117791 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-fe617c4c-2ae9-4aaa-b456-c6ff51fa2534 tempest-VolumesNegativeTest-1425167617 tempest-VolumesNegativeTest-1425167617-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004005 Oct 24 08:55:34.118561 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 430/852] 10.222.0.26 () {58 vars in 1137 bytes} [Mon Oct 24 08:55:34 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 24 08:55:34.127565 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-518244f9-8be5-487f-a001-ecc6b734bca5 tempest-VolumesNegativeTest-1425167617 tempest-VolumesNegativeTest-1425167617-project] Calling method '.version_select at 0x7f7ef19e0d30>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:34.163610 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.wsgi [None req-518244f9-8be5-487f-a001-ecc6b734bca5 tempest-VolumesNegativeTest-1425167617 tempest-VolumesNegativeTest-1425167617-project] HTTP exception thrown: Volume 2f59953f-ee03-4770-9732-c65d8c8d3903 could not be found. Oct 24 08:55:34.165621 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-518244f9-8be5-487f-a001-ecc6b734bca5 tempest-VolumesNegativeTest-1425167617 tempest-VolumesNegativeTest-1425167617-project] Request method failure captured: Oct 24 08:55:34.165621 dv-cinder-master-3-smb devstack@n-api.service[125164]: request: DELETE /compute/v2.1/os-volumes/2f59953f-ee03-4770-9732-c65d8c8d3903 HTTP/1.1 Oct 24 08:55:34.165621 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept: application/json Oct 24 08:55:34.165621 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept-Encoding: identity Oct 24 08:55:34.165621 dv-cinder-master-3-smb devstack@n-api.service[125164]: Connection: close Oct 24 08:55:34.165621 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Length: 0 Oct 24 08:55:34.165621 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Type: application/json Oct 24 08:55:34.165621 dv-cinder-master-3-smb devstack@n-api.service[125164]: Host: 10.222.0.26 Oct 24 08:55:34.165621 dv-cinder-master-3-smb devstack@n-api.service[125164]: Openstack-System-Scope: None Oct 24 08:55:34.165621 dv-cinder-master-3-smb devstack@n-api.service[125164]: User-Agent: python-urllib3/1.26.12 Oct 24 08:55:34.165621 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Auth-Token: gAAAAABjVlMFT9aCkUA50VglhjdNsfGMY8T98TgV2nF2rdVWqRGHLc1obSg4_JKJEGPiMR3fZbxUILQLNXsVr2sQ3rxtmMmGgjiRs9hF0WfMelfcQ8Bwiocji9rarALAAQ8eQEywnwTECJ4xnxNlmCccL-zOzNiUnA69pe6KwBkQLNVTm_zm1p0 Oct 24 08:55:34.165621 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Id: None Oct 24 08:55:34.165621 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Name: None Oct 24 08:55:34.165621 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Identity-Status: Confirmed Oct 24 08:55:34.165621 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Is-Admin-Project: True Oct 24 08:55:34.165621 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Id: default Oct 24 08:55:34.165621 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Name: Default Oct 24 08:55:34.165621 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Id: ff59dc49e8a945d3936f85d58c49774e Oct 24 08:55:34.165621 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Name: tempest-VolumesNegativeTest-1425167617 Oct 24 08:55:34.165621 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Role: reader,member Oct 24 08:55:34.165621 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Roles: reader,member Oct 24 08:55:34.172016 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ff59dc49e8a945d3936f85d58c49774e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ff59dc49e8a945d3936f85d58c49774e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ff59dc49e8a945d3936f85d58c49774e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ff59dc49e8a945d3936f85d58c49774e"}]}] Oct 24 08:55:34.172016 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant: tempest-VolumesNegativeTest-1425167617 Oct 24 08:55:34.172016 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Id: ff59dc49e8a945d3936f85d58c49774e Oct 24 08:55:34.172016 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Name: tempest-VolumesNegativeTest-1425167617 Oct 24 08:55:34.172016 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User: tempest-VolumesNegativeTest-1425167617-project Oct 24 08:55:34.172016 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Id: default Oct 24 08:55:34.172016 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Name: Default Oct 24 08:55:34.172016 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Id: 8b7cf0929a9c433ebde5a292a8f0f518 Oct 24 08:55:34.172016 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Name: tempest-VolumesNegativeTest-1425167617-project Oct 24 08:55:34.172016 dv-cinder-master-3-smb devstack@n-api.service[125164]: method: Oct 24 08:55:34.172016 dv-cinder-master-3-smb devstack@n-api.service[125164]: exception: Volume 2f59953f-ee03-4770-9732-c65d8c8d3903 could not be found. Oct 24 08:55:34.172016 dv-cinder-master-3-smb devstack@n-api.service[125164]: action_args: {'id': '2f59953f-ee03-4770-9732-c65d8c8d3903'} Oct 24 08:55:34.172016 dv-cinder-master-3-smb devstack@n-api.service[125164]: {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:55:34.173324 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:34.173324 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 08:55:34.173324 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 08:55:34.173324 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 24 08:55:34.173324 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 24 08:55:34.173324 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 24 08:55:34.173324 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 24 08:55:34.173324 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 24 08:55:34.173324 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 24 08:55:34.173324 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 24 08:55:34.173324 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 24 08:55:34.173324 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 08:55:34.173324 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 08:55:34.173324 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 08:55:34.173324 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 08:55:34.173324 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2f59953f-ee03-4770-9732-c65d8c8d3903 could not be found. (HTTP 404) (Request-ID: req-2147ed7a-ff2d-435b-98b6-45aa8826dd76) Oct 24 08:55:34.173324 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.173324 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:34.173324 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.175076 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:34.175076 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 24 08:55:34.175076 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 24 08:55:34.175076 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 08:55:34.175076 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 08:55:34.175076 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 08:55:34.175076 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 08:55:34.175076 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 08:55:34.175076 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 08:55:34.175076 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 08:55:34.175076 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 08:55:34.175076 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 24 08:55:34.175076 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 24 08:55:34.175076 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 24 08:55:34.175076 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 24 08:55:34.175076 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 24 08:55:34.175076 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 24 08:55:34.175076 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 24 08:55:34.175076 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 24 08:55:34.176615 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 08:55:34.176615 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 08:55:34.176615 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 08:55:34.176615 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 08:55:34.176615 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2f59953f-ee03-4770-9732-c65d8c8d3903 could not be found. Oct 24 08:55:34.176615 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.176615 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:34.176615 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.176615 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:34.176615 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:34.176615 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:34.176615 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:55:34.176615 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:55:34.176615 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:55:34.176615 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:55:34.176615 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:55:34.176615 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:55:34.176615 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 24 08:55:34.176615 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:55:34.177981 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2f59953f-ee03-4770-9732-c65d8c8d3903 could not be found. Oct 24 08:55:34.177981 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.177981 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:34.177981 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.177981 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:34.177981 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:34.177981 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:34.177981 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:55:34.177981 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:55:34.177981 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2f59953f-ee03-4770-9732-c65d8c8d3903 could not be found. Oct 24 08:55:34.177981 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.177981 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-518244f9-8be5-487f-a001-ecc6b734bca5 tempest-VolumesNegativeTest-1425167617 tempest-VolumesNegativeTest-1425167617-project] Returning 404 to user: Volume 2f59953f-ee03-4770-9732-c65d8c8d3903 could not be found. {{(pid=125164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:55:34.177981 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-518244f9-8be5-487f-a001-ecc6b734bca5 tempest-VolumesNegativeTest-1425167617 tempest-VolumesNegativeTest-1425167617-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/2f59953f-ee03-4770-9732-c65d8c8d3903" status: 404 len: 109 microversion: 2.1 time: 0.043458 Oct 24 08:55:34.177981 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 431/853] 10.222.0.26 () {58 vars in 1248 bytes} [Mon Oct 24 08:55:34 2022] DELETE /compute/v2.1/os-volumes/2f59953f-ee03-4770-9732-c65d8c8d3903 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:55:34.179083 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-85b20b22-ba30-4fe7-83c2-b8789462e9bd tempest-VolumesNegativeTest-1425167617 tempest-VolumesNegativeTest-1425167617-project] Calling method '.version_select at 0x7f7ef15d9e50>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:34.182240 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-98b506f9-60b6-44bc-8b15-24c80dddfe06 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:34.191053 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-98b506f9-60b6-44bc-8b15-24c80dddfe06 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:34.192818 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-98b506f9-60b6-44bc-8b15-24c80dddfe06 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:34.194134 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-98b506f9-60b6-44bc-8b15-24c80dddfe06 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1730 microversion: 2.20 time: 0.191286 Oct 24 08:55:34.194818 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 423/854] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:34 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:55:34.208765 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.wsgi [None req-85b20b22-ba30-4fe7-83c2-b8789462e9bd tempest-VolumesNegativeTest-1425167617 tempest-VolumesNegativeTest-1425167617-project] HTTP exception thrown: Volume 92952aef-fcc8-4948-8f05-fe93d7d1e5ab could not be found. Oct 24 08:55:34.211305 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-85b20b22-ba30-4fe7-83c2-b8789462e9bd tempest-VolumesNegativeTest-1425167617 tempest-VolumesNegativeTest-1425167617-project] Request method failure captured: Oct 24 08:55:34.211305 dv-cinder-master-3-smb devstack@n-api.service[125164]: request: GET /compute/v2.1/os-volumes/92952aef-fcc8-4948-8f05-fe93d7d1e5ab HTTP/1.1 Oct 24 08:55:34.211305 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept: application/json Oct 24 08:55:34.211305 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept-Encoding: identity Oct 24 08:55:34.211305 dv-cinder-master-3-smb devstack@n-api.service[125164]: Connection: close Oct 24 08:55:34.211305 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Length: 0 Oct 24 08:55:34.211305 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Type: application/json Oct 24 08:55:34.211305 dv-cinder-master-3-smb devstack@n-api.service[125164]: Host: 10.222.0.26 Oct 24 08:55:34.211305 dv-cinder-master-3-smb devstack@n-api.service[125164]: Openstack-System-Scope: None Oct 24 08:55:34.211305 dv-cinder-master-3-smb devstack@n-api.service[125164]: User-Agent: python-urllib3/1.26.12 Oct 24 08:55:34.211305 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Auth-Token: gAAAAABjVlMFT9aCkUA50VglhjdNsfGMY8T98TgV2nF2rdVWqRGHLc1obSg4_JKJEGPiMR3fZbxUILQLNXsVr2sQ3rxtmMmGgjiRs9hF0WfMelfcQ8Bwiocji9rarALAAQ8eQEywnwTECJ4xnxNlmCccL-zOzNiUnA69pe6KwBkQLNVTm_zm1p0 Oct 24 08:55:34.211305 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Id: None Oct 24 08:55:34.211305 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Name: None Oct 24 08:55:34.211305 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Identity-Status: Confirmed Oct 24 08:55:34.211305 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Is-Admin-Project: True Oct 24 08:55:34.211305 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Id: default Oct 24 08:55:34.211305 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Name: Default Oct 24 08:55:34.211305 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Id: ff59dc49e8a945d3936f85d58c49774e Oct 24 08:55:34.211305 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Name: tempest-VolumesNegativeTest-1425167617 Oct 24 08:55:34.211305 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Role: reader,member Oct 24 08:55:34.211305 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Roles: reader,member Oct 24 08:55:34.212903 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ff59dc49e8a945d3936f85d58c49774e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ff59dc49e8a945d3936f85d58c49774e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ff59dc49e8a945d3936f85d58c49774e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ff59dc49e8a945d3936f85d58c49774e"}]}] Oct 24 08:55:34.212903 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant: tempest-VolumesNegativeTest-1425167617 Oct 24 08:55:34.212903 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Id: ff59dc49e8a945d3936f85d58c49774e Oct 24 08:55:34.212903 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Name: tempest-VolumesNegativeTest-1425167617 Oct 24 08:55:34.212903 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User: tempest-VolumesNegativeTest-1425167617-project Oct 24 08:55:34.212903 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Id: default Oct 24 08:55:34.212903 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Name: Default Oct 24 08:55:34.212903 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Id: 8b7cf0929a9c433ebde5a292a8f0f518 Oct 24 08:55:34.212903 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Name: tempest-VolumesNegativeTest-1425167617-project Oct 24 08:55:34.212903 dv-cinder-master-3-smb devstack@n-api.service[125164]: method: Oct 24 08:55:34.212903 dv-cinder-master-3-smb devstack@n-api.service[125164]: exception: Volume 92952aef-fcc8-4948-8f05-fe93d7d1e5ab could not be found. Oct 24 08:55:34.212903 dv-cinder-master-3-smb devstack@n-api.service[125164]: action_args: {'id': '92952aef-fcc8-4948-8f05-fe93d7d1e5ab'} Oct 24 08:55:34.212903 dv-cinder-master-3-smb devstack@n-api.service[125164]: {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:55:34.213815 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:34.213815 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 08:55:34.213815 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 08:55:34.213815 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 08:55:34.213815 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 08:55:34.213815 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 08:55:34.213815 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 08:55:34.213815 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 08:55:34.213815 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 08:55:34.213815 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 08:55:34.213815 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 08:55:34.213815 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 08:55:34.213815 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 08:55:34.213815 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 08:55:34.213815 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 08:55:34.213815 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 92952aef-fcc8-4948-8f05-fe93d7d1e5ab could not be found. (HTTP 404) (Request-ID: req-6b592252-a459-449b-8073-48dd2f1b98d7) Oct 24 08:55:34.213815 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.213815 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:34.213815 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.215340 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:34.215340 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 24 08:55:34.215340 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 24 08:55:34.215340 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 08:55:34.215340 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 08:55:34.215340 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 08:55:34.215340 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 08:55:34.215340 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 08:55:34.215340 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 08:55:34.215340 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 08:55:34.215340 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 08:55:34.215340 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 08:55:34.215340 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 08:55:34.215340 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 08:55:34.215340 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 08:55:34.215340 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 08:55:34.215340 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 08:55:34.215340 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 08:55:34.215340 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 08:55:34.216879 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 08:55:34.216879 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 08:55:34.216879 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 08:55:34.216879 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 08:55:34.216879 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 92952aef-fcc8-4948-8f05-fe93d7d1e5ab could not be found. Oct 24 08:55:34.216879 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.216879 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:34.216879 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.216879 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:34.216879 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:34.216879 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:34.216879 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:55:34.216879 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:55:34.216879 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 08:55:34.216879 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 08:55:34.216879 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:55:34.216879 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:55:34.216879 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 24 08:55:34.216879 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:55:34.218176 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 92952aef-fcc8-4948-8f05-fe93d7d1e5ab could not be found. Oct 24 08:55:34.218176 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.218176 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:55:34.218176 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.218176 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:55:34.218176 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:55:34.218176 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:55:34.218176 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:55:34.218176 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:55:34.218176 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 92952aef-fcc8-4948-8f05-fe93d7d1e5ab could not be found. Oct 24 08:55:34.218176 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:55:34.218176 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-85b20b22-ba30-4fe7-83c2-b8789462e9bd tempest-VolumesNegativeTest-1425167617 tempest-VolumesNegativeTest-1425167617-project] Returning 404 to user: Volume 92952aef-fcc8-4948-8f05-fe93d7d1e5ab could not be found. {{(pid=125164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:55:34.218176 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-85b20b22-ba30-4fe7-83c2-b8789462e9bd tempest-VolumesNegativeTest-1425167617 tempest-VolumesNegativeTest-1425167617-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/92952aef-fcc8-4948-8f05-fe93d7d1e5ab" status: 404 len: 109 microversion: 2.1 time: 0.039550 Oct 24 08:55:34.218176 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 432/855] 10.222.0.26 () {58 vars in 1245 bytes} [Mon Oct 24 08:55:34 2022] GET /compute/v2.1/os-volumes/92952aef-fcc8-4948-8f05-fe93d7d1e5ab => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 08:55:35.219687 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-0e6f7722-8b10-4876-acd0-fc8d5d439dbe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:35.220311 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-0e6f7722-8b10-4876-acd0-fc8d5d439dbe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:35.228619 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0e6f7722-8b10-4876-acd0-fc8d5d439dbe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:35.229163 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0e6f7722-8b10-4876-acd0-fc8d5d439dbe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:35.229604 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0e6f7722-8b10-4876-acd0-fc8d5d439dbe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:35.230308 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0e6f7722-8b10-4876-acd0-fc8d5d439dbe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:35.230795 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0e6f7722-8b10-4876-acd0-fc8d5d439dbe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:35.231215 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0e6f7722-8b10-4876-acd0-fc8d5d439dbe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:35.364925 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-0e6f7722-8b10-4876-acd0-fc8d5d439dbe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:35.374476 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-0e6f7722-8b10-4876-acd0-fc8d5d439dbe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:35.375935 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-0e6f7722-8b10-4876-acd0-fc8d5d439dbe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:35.377094 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-0e6f7722-8b10-4876-acd0-fc8d5d439dbe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1730 microversion: 2.20 time: 0.161444 Oct 24 08:55:35.377653 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 424/856] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:35 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:36.402403 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-59ca00bf-914b-46b9-9acc-617cc670c61c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:36.403226 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-59ca00bf-914b-46b9-9acc-617cc670c61c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:36.409940 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-59ca00bf-914b-46b9-9acc-617cc670c61c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:36.410686 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-59ca00bf-914b-46b9-9acc-617cc670c61c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:36.411190 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-59ca00bf-914b-46b9-9acc-617cc670c61c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:36.411867 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-59ca00bf-914b-46b9-9acc-617cc670c61c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:36.412315 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-59ca00bf-914b-46b9-9acc-617cc670c61c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:36.412734 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-59ca00bf-914b-46b9-9acc-617cc670c61c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:36.417113 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:36.566750 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-59ca00bf-914b-46b9-9acc-617cc670c61c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:36.575406 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-59ca00bf-914b-46b9-9acc-617cc670c61c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:36.576959 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-59ca00bf-914b-46b9-9acc-617cc670c61c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:36.578130 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-59ca00bf-914b-46b9-9acc-617cc670c61c tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1730 microversion: 2.20 time: 0.180205 Oct 24 08:55:36.578912 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 433/857] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:36 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:37.604767 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-ece11861-0677-4a81-92c6-c6f25979773b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:37.605458 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-ece11861-0677-4a81-92c6-c6f25979773b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:37.612154 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ece11861-0677-4a81-92c6-c6f25979773b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:37.612701 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ece11861-0677-4a81-92c6-c6f25979773b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:37.613116 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ece11861-0677-4a81-92c6-c6f25979773b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:37.613820 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ece11861-0677-4a81-92c6-c6f25979773b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:37.614268 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ece11861-0677-4a81-92c6-c6f25979773b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:37.614695 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ece11861-0677-4a81-92c6-c6f25979773b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:37.756992 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-ece11861-0677-4a81-92c6-c6f25979773b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:37.771448 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-ece11861-0677-4a81-92c6-c6f25979773b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:37.773313 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-ece11861-0677-4a81-92c6-c6f25979773b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:37.774620 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-ece11861-0677-4a81-92c6-c6f25979773b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1730 microversion: 2.20 time: 0.174598 Oct 24 08:55:37.775828 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 425/858] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:37 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:38.803118 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-8256c6b1-a036-4eb2-bf01-3142a652e587 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:38.804405 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-8256c6b1-a036-4eb2-bf01-3142a652e587 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:38.810551 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8256c6b1-a036-4eb2-bf01-3142a652e587 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:38.811054 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8256c6b1-a036-4eb2-bf01-3142a652e587 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:38.811484 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8256c6b1-a036-4eb2-bf01-3142a652e587 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:38.812169 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8256c6b1-a036-4eb2-bf01-3142a652e587 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:38.812614 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8256c6b1-a036-4eb2-bf01-3142a652e587 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:38.813028 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8256c6b1-a036-4eb2-bf01-3142a652e587 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:38.999519 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-8256c6b1-a036-4eb2-bf01-3142a652e587 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:39.008357 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-8256c6b1-a036-4eb2-bf01-3142a652e587 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:39.012365 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-8256c6b1-a036-4eb2-bf01-3142a652e587 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:39.013851 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-8256c6b1-a036-4eb2-bf01-3142a652e587 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1730 microversion: 2.20 time: 0.216088 Oct 24 08:55:39.021241 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 434/859] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:38 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1730 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:40.044448 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-5f63d6f5-03f3-4375-8b8d-6bdddb70f754 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:40.045062 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-5f63d6f5-03f3-4375-8b8d-6bdddb70f754 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:40.051581 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5f63d6f5-03f3-4375-8b8d-6bdddb70f754 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:40.052145 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5f63d6f5-03f3-4375-8b8d-6bdddb70f754 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:40.052594 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5f63d6f5-03f3-4375-8b8d-6bdddb70f754 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:40.053430 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5f63d6f5-03f3-4375-8b8d-6bdddb70f754 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:40.053877 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5f63d6f5-03f3-4375-8b8d-6bdddb70f754 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:40.054279 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5f63d6f5-03f3-4375-8b8d-6bdddb70f754 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:40.073904 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:40.198695 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-5f63d6f5-03f3-4375-8b8d-6bdddb70f754 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:40.208388 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-5f63d6f5-03f3-4375-8b8d-6bdddb70f754 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:40.210955 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-5f63d6f5-03f3-4375-8b8d-6bdddb70f754 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:40.212521 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-5f63d6f5-03f3-4375-8b8d-6bdddb70f754 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1730 microversion: 2.20 time: 0.176928 Oct 24 08:55:40.213112 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 426/860] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:40 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:41.048426 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-152a53be-4c5c-4c81-a896-7287bfcd965e req-1a1f5981-7b44-4488-8337-73c21239d85e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa2753cf-624f-4bf1-b85b-0fef0e35521c", "name": "network-vif-plugged", "status": "completed", "tag": "8db8d394-e903-4fe4-92d4-9750c49eb4c4"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:55:41.059292 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-152a53be-4c5c-4c81-a896-7287bfcd965e req-1a1f5981-7b44-4488-8337-73c21239d85e service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:41.059873 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-152a53be-4c5c-4c81-a896-7287bfcd965e req-1a1f5981-7b44-4488-8337-73c21239d85e service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:41.060360 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-152a53be-4c5c-4c81-a896-7287bfcd965e req-1a1f5981-7b44-4488-8337-73c21239d85e service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:41.072790 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-152a53be-4c5c-4c81-a896-7287bfcd965e req-1a1f5981-7b44-4488-8337-73c21239d85e service nova] Creating event network-vif-plugged:8db8d394-e903-4fe4-92d4-9750c49eb4c4 for instance aa2753cf-624f-4bf1-b85b-0fef0e35521c on hv-cinder-maste Oct 24 08:55:41.078271 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-152a53be-4c5c-4c81-a896-7287bfcd965e req-1a1f5981-7b44-4488-8337-73c21239d85e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034136 Oct 24 08:55:41.079122 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 435/861] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:55:41.237980 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-ebbebb46-5cb7-4013-873b-5418a71e54f0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:41.238583 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-ebbebb46-5cb7-4013-873b-5418a71e54f0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:41.245369 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ebbebb46-5cb7-4013-873b-5418a71e54f0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:41.245866 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ebbebb46-5cb7-4013-873b-5418a71e54f0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:41.246305 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ebbebb46-5cb7-4013-873b-5418a71e54f0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:41.247027 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ebbebb46-5cb7-4013-873b-5418a71e54f0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:41.247523 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ebbebb46-5cb7-4013-873b-5418a71e54f0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:41.247945 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ebbebb46-5cb7-4013-873b-5418a71e54f0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:41.443495 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-ebbebb46-5cb7-4013-873b-5418a71e54f0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:41.455853 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-ebbebb46-5cb7-4013-873b-5418a71e54f0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:41.457399 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-ebbebb46-5cb7-4013-873b-5418a71e54f0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:41.459275 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-ebbebb46-5cb7-4013-873b-5418a71e54f0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1730 microversion: 2.20 time: 0.225070 Oct 24 08:55:41.460145 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 427/862] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:41 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1730 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:42.492079 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-6fe75429-22ac-4ef4-b0a3-699d5b1a4dcf tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:42.493006 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-6fe75429-22ac-4ef4-b0a3-699d5b1a4dcf tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:42.504990 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6fe75429-22ac-4ef4-b0a3-699d5b1a4dcf tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:42.505563 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6fe75429-22ac-4ef4-b0a3-699d5b1a4dcf tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:42.506100 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6fe75429-22ac-4ef4-b0a3-699d5b1a4dcf tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:42.506900 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6fe75429-22ac-4ef4-b0a3-699d5b1a4dcf tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:42.507387 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6fe75429-22ac-4ef4-b0a3-699d5b1a4dcf tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:42.508380 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-6fe75429-22ac-4ef4-b0a3-699d5b1a4dcf tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:42.665396 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-6fe75429-22ac-4ef4-b0a3-699d5b1a4dcf tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:42.674409 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-6fe75429-22ac-4ef4-b0a3-699d5b1a4dcf tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:42.676282 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-6fe75429-22ac-4ef4-b0a3-699d5b1a4dcf tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:42.678550 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-6fe75429-22ac-4ef4-b0a3-699d5b1a4dcf tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1730 microversion: 2.20 time: 0.195182 Oct 24 08:55:42.679153 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 436/863] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:42 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1730 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:43.704453 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-8ce28d4c-0d98-4938-9e6f-81773dce6185 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:43.705283 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-8ce28d4c-0d98-4938-9e6f-81773dce6185 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:43.712164 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8ce28d4c-0d98-4938-9e6f-81773dce6185 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:43.712779 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8ce28d4c-0d98-4938-9e6f-81773dce6185 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:43.713161 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8ce28d4c-0d98-4938-9e6f-81773dce6185 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:43.713971 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8ce28d4c-0d98-4938-9e6f-81773dce6185 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:43.714329 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8ce28d4c-0d98-4938-9e6f-81773dce6185 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:43.715034 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8ce28d4c-0d98-4938-9e6f-81773dce6185 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:43.867470 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-8ce28d4c-0d98-4938-9e6f-81773dce6185 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:43.877714 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-8ce28d4c-0d98-4938-9e6f-81773dce6185 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:43.879553 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-8ce28d4c-0d98-4938-9e6f-81773dce6185 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:43.880962 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-8ce28d4c-0d98-4938-9e6f-81773dce6185 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1730 microversion: 2.20 time: 0.180830 Oct 24 08:55:43.881703 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 428/864] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:43 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:55:44.909045 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-c4fd6c1e-5afe-4ddd-90f6-cb79919c4199 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:55:44.909678 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-c4fd6c1e-5afe-4ddd-90f6-cb79919c4199 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:55:44.916483 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c4fd6c1e-5afe-4ddd-90f6-cb79919c4199 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:44.916988 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c4fd6c1e-5afe-4ddd-90f6-cb79919c4199 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:44.917478 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c4fd6c1e-5afe-4ddd-90f6-cb79919c4199 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:44.918173 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c4fd6c1e-5afe-4ddd-90f6-cb79919c4199 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:55:44.918745 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c4fd6c1e-5afe-4ddd-90f6-cb79919c4199 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:55:44.919280 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c4fd6c1e-5afe-4ddd-90f6-cb79919c4199 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:55:45.055350 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-c4fd6c1e-5afe-4ddd-90f6-cb79919c4199 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:45.063914 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-c4fd6c1e-5afe-4ddd-90f6-cb79919c4199 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:45.065340 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-c4fd6c1e-5afe-4ddd-90f6-cb79919c4199 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:55:45.066536 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-c4fd6c1e-5afe-4ddd-90f6-cb79919c4199 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1717 microversion: 2.20 time: 0.161433 Oct 24 08:55:45.067628 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 437/865] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:55:44 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1717 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:56:10.950589 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-ee235e45-91cf-48f7-ad53-c2a10fadb97b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:10.951143 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-ee235e45-91cf-48f7-ad53-c2a10fadb97b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 83642ea6-d946-47b5-9d5a-e606cea14f3e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:10.953317 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_api:SELECT=21 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:10.953977 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell1:SELECT=14 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:10.960364 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ee235e45-91cf-48f7-ad53-c2a10fadb97b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:10.960841 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ee235e45-91cf-48f7-ad53-c2a10fadb97b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:10.961268 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ee235e45-91cf-48f7-ad53-c2a10fadb97b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:10.961944 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ee235e45-91cf-48f7-ad53-c2a10fadb97b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:10.962389 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ee235e45-91cf-48f7-ad53-c2a10fadb97b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:10.962832 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ee235e45-91cf-48f7-ad53-c2a10fadb97b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:10.986091 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-ee235e45-91cf-48f7-ad53-c2a10fadb97b tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e/ips" status: 200 len: 151 microversion: 2.1 time: 0.039341 Oct 24 08:56:10.986651 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 429/866] 10.222.0.26 () {58 vars in 1248 bytes} [Mon Oct 24 08:56:10 2022] GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:12.345043 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-c13e59cd-518c-4b2c-9458-c9b30e38ca8d tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09d2093d-4727-4fb7-afc8-c1e4b5e9072a"}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:12.347566 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-c13e59cd-518c-4b2c-9458-c9b30e38ca8d tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 83642ea6-d946-47b5-9d5a-e606cea14f3e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:12.350124 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_api:SELECT=11 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:12.350883 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell1:SELECT=25 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:12.357650 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c13e59cd-518c-4b2c-9458-c9b30e38ca8d tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:12.358134 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c13e59cd-518c-4b2c-9458-c9b30e38ca8d tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:12.358578 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c13e59cd-518c-4b2c-9458-c9b30e38ca8d tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:12.359277 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c13e59cd-518c-4b2c-9458-c9b30e38ca8d tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:12.359724 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c13e59cd-518c-4b2c-9458-c9b30e38ca8d tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:12.360138 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c13e59cd-518c-4b2c-9458-c9b30e38ca8d tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:12.631962 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-c13e59cd-518c-4b2c-9458-c9b30e38ca8d tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "POST /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290755 Oct 24 08:56:12.633347 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 438/867] 10.222.0.26 () {60 vars in 1323 bytes} [Mon Oct 24 08:56:12 2022] POST /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:56:15.034101 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-f0bc8850-6797-4042-a5e5-0b818c410ae8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:15.034577 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-f0bc8850-6797-4042-a5e5-0b818c410ae8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 83642ea6-d946-47b5-9d5a-e606cea14f3e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:15.043402 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f0bc8850-6797-4042-a5e5-0b818c410ae8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:15.043973 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f0bc8850-6797-4042-a5e5-0b818c410ae8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:15.044510 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f0bc8850-6797-4042-a5e5-0b818c410ae8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:15.046671 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f0bc8850-6797-4042-a5e5-0b818c410ae8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:15.047212 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f0bc8850-6797-4042-a5e5-0b818c410ae8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:15.048705 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f0bc8850-6797-4042-a5e5-0b818c410ae8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:15.137171 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.objects.instance [None req-f0bc8850-6797-4042-a5e5-0b818c410ae8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lazy-loading 'services' on Instance uuid 83642ea6-d946-47b5-9d5a-e606cea14f3e {{(pid=125165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:56:15.218255 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-f0bc8850-6797-4042-a5e5-0b818c410ae8 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "DELETE /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e/os-volume_attachments/09d2093d-4727-4fb7-afc8-c1e4b5e9072a" status: 202 len: 0 microversion: 2.1 time: 0.188138 Oct 24 08:56:15.219380 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 430/868] 10.222.0.26 () {58 vars in 1416 bytes} [Mon Oct 24 08:56:15 2022] DELETE /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e/os-volume_attachments/09d2093d-4727-4fb7-afc8-c1e4b5e9072a => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:56:15.228874 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-a68e5392-4c26-47aa-82f8-092dbaa4d64a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:15.235526 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-a68e5392-4c26-47aa-82f8-092dbaa4d64a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 83642ea6-d946-47b5-9d5a-e606cea14f3e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:15.250270 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a68e5392-4c26-47aa-82f8-092dbaa4d64a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:15.251010 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a68e5392-4c26-47aa-82f8-092dbaa4d64a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:15.251542 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a68e5392-4c26-47aa-82f8-092dbaa4d64a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:15.252408 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a68e5392-4c26-47aa-82f8-092dbaa4d64a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:15.252960 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a68e5392-4c26-47aa-82f8-092dbaa4d64a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:15.253487 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a68e5392-4c26-47aa-82f8-092dbaa4d64a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:15.296053 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-a68e5392-4c26-47aa-82f8-092dbaa4d64a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071890 Oct 24 08:56:15.314886 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 439/869] 10.222.0.26 () {58 vars in 1302 bytes} [Mon Oct 24 08:56:15 2022] GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:16.324415 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-2a57bcff-3515-4d83-8bba-c82dc2d1638f tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:16.326841 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-2a57bcff-3515-4d83-8bba-c82dc2d1638f tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 83642ea6-d946-47b5-9d5a-e606cea14f3e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:16.333308 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2a57bcff-3515-4d83-8bba-c82dc2d1638f tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:16.333792 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2a57bcff-3515-4d83-8bba-c82dc2d1638f tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:16.334259 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2a57bcff-3515-4d83-8bba-c82dc2d1638f tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:16.334970 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2a57bcff-3515-4d83-8bba-c82dc2d1638f tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:16.335580 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2a57bcff-3515-4d83-8bba-c82dc2d1638f tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:16.336197 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2a57bcff-3515-4d83-8bba-c82dc2d1638f tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:16.370416 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-2a57bcff-3515-4d83-8bba-c82dc2d1638f tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051238 Oct 24 08:56:16.371147 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 431/870] 10.222.0.26 () {58 vars in 1302 bytes} [Mon Oct 24 08:56:16 2022] GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:56:16.442638 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-7614302e-3434-4922-8fca-070e0bff7df5 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:16.443265 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-7614302e-3434-4922-8fca-070e0bff7df5 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 83642ea6-d946-47b5-9d5a-e606cea14f3e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:16.449651 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7614302e-3434-4922-8fca-070e0bff7df5 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:16.450574 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7614302e-3434-4922-8fca-070e0bff7df5 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:16.451063 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7614302e-3434-4922-8fca-070e0bff7df5 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:16.451775 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7614302e-3434-4922-8fca-070e0bff7df5 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:16.452237 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7614302e-3434-4922-8fca-070e0bff7df5 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:16.452647 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7614302e-3434-4922-8fca-070e0bff7df5 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:16.480228 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-7614302e-3434-4922-8fca-070e0bff7df5 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 83642ea6-d946-47b5-9d5a-e606cea14f3e] Going to try to terminate instance {{(pid=125164) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:56:16.584330 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-7614302e-3434-4922-8fca-070e0bff7df5 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "DELETE /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e" status: 204 len: 0 microversion: 2.1 time: 0.145261 Oct 24 08:56:16.585776 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 440/871] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Oct 24 08:56:16 2022] DELETE /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:56:16.593940 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-58828014-7de9-4344-9b54-b9df97bcb871 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:16.594557 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-58828014-7de9-4344-9b54-b9df97bcb871 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 83642ea6-d946-47b5-9d5a-e606cea14f3e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:16.601571 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-58828014-7de9-4344-9b54-b9df97bcb871 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:16.602058 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-58828014-7de9-4344-9b54-b9df97bcb871 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:16.602493 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-58828014-7de9-4344-9b54-b9df97bcb871 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:16.603225 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-58828014-7de9-4344-9b54-b9df97bcb871 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:16.603673 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-58828014-7de9-4344-9b54-b9df97bcb871 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:16.604128 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-58828014-7de9-4344-9b54-b9df97bcb871 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:16.756244 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-58828014-7de9-4344-9b54-b9df97bcb871 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:16.764841 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-58828014-7de9-4344-9b54-b9df97bcb871 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e" status: 200 len: 1683 microversion: 2.1 time: 0.174953 Oct 24 08:56:16.765594 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 432/872] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:16 2022] GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:17.791700 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-b7fa145d-b3ba-4ca9-b285-4e98db9fff36 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:17.794217 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-b7fa145d-b3ba-4ca9-b285-4e98db9fff36 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 83642ea6-d946-47b5-9d5a-e606cea14f3e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:17.804493 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b7fa145d-b3ba-4ca9-b285-4e98db9fff36 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:17.805341 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b7fa145d-b3ba-4ca9-b285-4e98db9fff36 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:17.806130 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b7fa145d-b3ba-4ca9-b285-4e98db9fff36 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:17.807394 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b7fa145d-b3ba-4ca9-b285-4e98db9fff36 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:17.808221 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b7fa145d-b3ba-4ca9-b285-4e98db9fff36 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:17.809073 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b7fa145d-b3ba-4ca9-b285-4e98db9fff36 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:17.948838 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-b7fa145d-b3ba-4ca9-b285-4e98db9fff36 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:17.956658 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-b7fa145d-b3ba-4ca9-b285-4e98db9fff36 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e" status: 200 len: 1683 microversion: 2.1 time: 0.172200 Oct 24 08:56:17.957171 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 441/873] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:17 2022] GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:18.980236 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-090dd8b1-d0dd-4f1d-8193-bd1ea03eafb9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:18.981425 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-090dd8b1-d0dd-4f1d-8193-bd1ea03eafb9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 83642ea6-d946-47b5-9d5a-e606cea14f3e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:18.988479 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-090dd8b1-d0dd-4f1d-8193-bd1ea03eafb9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:18.989080 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-090dd8b1-d0dd-4f1d-8193-bd1ea03eafb9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:18.989519 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-090dd8b1-d0dd-4f1d-8193-bd1ea03eafb9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:18.990278 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-090dd8b1-d0dd-4f1d-8193-bd1ea03eafb9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:18.990967 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-090dd8b1-d0dd-4f1d-8193-bd1ea03eafb9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:18.991396 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-090dd8b1-d0dd-4f1d-8193-bd1ea03eafb9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:19.340638 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-090dd8b1-d0dd-4f1d-8193-bd1ea03eafb9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:19.350044 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-090dd8b1-d0dd-4f1d-8193-bd1ea03eafb9 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e" status: 200 len: 1683 microversion: 2.1 time: 0.374109 Oct 24 08:56:19.350826 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 433/874] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:18 2022] GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e => generated 1683 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:20.373832 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-52671974-ff55-4b3b-9895-1efd8624b39a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:20.374464 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-52671974-ff55-4b3b-9895-1efd8624b39a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 83642ea6-d946-47b5-9d5a-e606cea14f3e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:20.387948 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-a355f394-def8-4537-9532-04ced46c271f req-94e462e8-2bd7-47f1-83f6-436d74954359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83642ea6-d946-47b5-9d5a-e606cea14f3e", "name": "network-vif-deleted", "tag": "cf121c67-a47e-4ac2-91ae-60b1955ad16e"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:20.416126 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-a355f394-def8-4537-9532-04ced46c271f req-94e462e8-2bd7-47f1-83f6-436d74954359 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:20.416608 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-a355f394-def8-4537-9532-04ced46c271f req-94e462e8-2bd7-47f1-83f6-436d74954359 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:20.417032 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-a355f394-def8-4537-9532-04ced46c271f req-94e462e8-2bd7-47f1-83f6-436d74954359 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:20.422413 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-52671974-ff55-4b3b-9895-1efd8624b39a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:20.423901 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-52671974-ff55-4b3b-9895-1efd8624b39a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:20.424541 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-52671974-ff55-4b3b-9895-1efd8624b39a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:20.425479 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-52671974-ff55-4b3b-9895-1efd8624b39a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:20.426147 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-52671974-ff55-4b3b-9895-1efd8624b39a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:20.426852 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-52671974-ff55-4b3b-9895-1efd8624b39a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:20.456464 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-a355f394-def8-4537-9532-04ced46c271f req-94e462e8-2bd7-47f1-83f6-436d74954359 service nova] Creating event network-vif-deleted:cf121c67-a47e-4ac2-91ae-60b1955ad16e for instance 83642ea6-d946-47b5-9d5a-e606cea14f3e on hv-cinder-maste Oct 24 08:56:20.473526 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-a355f394-def8-4537-9532-04ced46c271f req-94e462e8-2bd7-47f1-83f6-436d74954359 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089212 Oct 24 08:56:20.474635 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 434/875] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:20.566037 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-52671974-ff55-4b3b-9895-1efd8624b39a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712e5cf4cc004918817ab1802b9c69d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02be1b30677f400788b35b03938e44e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:20.585692 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-52671974-ff55-4b3b-9895-1efd8624b39a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e" status: 200 len: 1616 microversion: 2.1 time: 0.206375 Oct 24 08:56:20.586979 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 442/876] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:20 2022] GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e => generated 1616 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:21.612502 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-a6ef6927-0c93-49e6-92f3-a6d418c70e09 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:21.613203 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-a6ef6927-0c93-49e6-92f3-a6d418c70e09 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 83642ea6-d946-47b5-9d5a-e606cea14f3e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:21.629644 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a6ef6927-0c93-49e6-92f3-a6d418c70e09 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:21.630288 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a6ef6927-0c93-49e6-92f3-a6d418c70e09 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:21.631070 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a6ef6927-0c93-49e6-92f3-a6d418c70e09 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:21.633204 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a6ef6927-0c93-49e6-92f3-a6d418c70e09 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:21.637632 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a6ef6927-0c93-49e6-92f3-a6d418c70e09 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:21.646202 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a6ef6927-0c93-49e6-92f3-a6d418c70e09 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:21.668739 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.wsgi [None req-a6ef6927-0c93-49e6-92f3-a6d418c70e09 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] HTTP exception thrown: Instance 83642ea6-d946-47b5-9d5a-e606cea14f3e could not be found. Oct 24 08:56:21.676666 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-a6ef6927-0c93-49e6-92f3-a6d418c70e09 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Request method failure captured: Oct 24 08:56:21.676666 dv-cinder-master-3-smb devstack@n-api.service[125165]: request: GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e HTTP/1.1 Oct 24 08:56:21.676666 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept: application/json Oct 24 08:56:21.676666 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept-Encoding: identity Oct 24 08:56:21.676666 dv-cinder-master-3-smb devstack@n-api.service[125165]: Connection: close Oct 24 08:56:21.676666 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Length: 0 Oct 24 08:56:21.676666 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Type: application/json Oct 24 08:56:21.676666 dv-cinder-master-3-smb devstack@n-api.service[125165]: Host: 10.222.0.26 Oct 24 08:56:21.676666 dv-cinder-master-3-smb devstack@n-api.service[125165]: Openstack-System-Scope: None Oct 24 08:56:21.676666 dv-cinder-master-3-smb devstack@n-api.service[125165]: User-Agent: python-urllib3/1.26.12 Oct 24 08:56:21.676666 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Auth-Token: gAAAAABjVlE2u8htP-0ukfebxjPQ_Tv08AEgRkqfcKErVq7KuTRTMT0ulC9K9eGWmc0J9Q6UTd3t0f_FhG9s34JNa-sHLE0_eBaC2GRhGdxZJM_viMU6wO-8X3T5-_M7hKYRa28fguCQkp2kM0S7f5w35MMqRh0sMsrU0PYXCVdXzPLgYLOBkKQ Oct 24 08:56:21.676666 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Id: None Oct 24 08:56:21.676666 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Name: None Oct 24 08:56:21.676666 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Identity-Status: Confirmed Oct 24 08:56:21.676666 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Is-Admin-Project: True Oct 24 08:56:21.676666 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Id: default Oct 24 08:56:21.676666 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Name: Default Oct 24 08:56:21.676666 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Id: 02be1b30677f400788b35b03938e44e5 Oct 24 08:56:21.676666 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Name: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:56:21.676666 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Role: reader,member Oct 24 08:56:21.676666 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Roles: reader,member Oct 24 08:56:21.678416 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_02be1b30677f400788b35b03938e44e5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/02be1b30677f400788b35b03938e44e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02be1b30677f400788b35b03938e44e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02be1b30677f400788b35b03938e44e5"}]}] Oct 24 08:56:21.678416 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:56:21.678416 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Id: 02be1b30677f400788b35b03938e44e5 Oct 24 08:56:21.678416 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:56:21.678416 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User: tempest-AttachVolumeNegativeTest-1868225476-project Oct 24 08:56:21.678416 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Id: default Oct 24 08:56:21.678416 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Name: Default Oct 24 08:56:21.678416 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Id: 712e5cf4cc004918817ab1802b9c69d6 Oct 24 08:56:21.678416 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Name: tempest-AttachVolumeNegativeTest-1868225476-project Oct 24 08:56:21.678416 dv-cinder-master-3-smb devstack@n-api.service[125165]: method: > Oct 24 08:56:21.678416 dv-cinder-master-3-smb devstack@n-api.service[125165]: exception: Instance 83642ea6-d946-47b5-9d5a-e606cea14f3e could not be found. Oct 24 08:56:21.678416 dv-cinder-master-3-smb devstack@n-api.service[125165]: action_args: {'id': '83642ea6-d946-47b5-9d5a-e606cea14f3e'} Oct 24 08:56:21.679398 dv-cinder-master-3-smb devstack@n-api.service[125165]: {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:56:21.679398 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:21.679398 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:56:21.679398 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:56:21.679398 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:56:21.679398 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:56:21.679398 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:56:21.679398 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:56:21.679398 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:56:21.679398 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:56:21.679398 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83642ea6-d946-47b5-9d5a-e606cea14f3e could not be found. Oct 24 08:56:21.679398 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:56:21.679398 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:21.679398 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:56:21.679398 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:21.679398 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:21.679398 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:21.679398 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:56:21.679398 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:56:21.679398 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:56:21.680701 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:56:21.680701 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:56:21.680701 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:56:21.680701 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:56:21.680701 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:56:21.680701 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:56:21.680701 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:56:21.680701 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83642ea6-d946-47b5-9d5a-e606cea14f3e could not be found. Oct 24 08:56:21.680701 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:56:21.680701 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:21.680701 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:56:21.680701 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:21.680701 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:21.680701 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:21.680701 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:56:21.680701 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:56:21.680701 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83642ea6-d946-47b5-9d5a-e606cea14f3e could not be found. Oct 24 08:56:21.680701 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:56:21.682444 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-a6ef6927-0c93-49e6-92f3-a6d418c70e09 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Returning 404 to user: Instance 83642ea6-d946-47b5-9d5a-e606cea14f3e could not be found. {{(pid=125165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:56:21.682444 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-a6ef6927-0c93-49e6-92f3-a6d418c70e09 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e" status: 404 len: 111 microversion: 2.1 time: 0.070978 Oct 24 08:56:21.682444 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 435/877] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:21 2022] GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:56:21.690293 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-dfb80db7-6aa1-49ad-8251-dccd5e637139 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '.version_select at 0x7f7ef17994c0>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:21.718420 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-dfb80db7-6aa1-49ad-8251-dccd5e637139 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1059438653" status: 202 len: 0 microversion: 2.1 time: 0.032670 Oct 24 08:56:21.718420 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 443/878] 10.222.0.26 () {58 vars in 1221 bytes} [Mon Oct 24 08:56:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1059438653 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:56:23.927742 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-7cec2a1b-dadd-4bc6-a5ae-d67747cad8dd tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Action: 'create', calling method: .version_select at 0x7f7ef142e1f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-805533992", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENVN5oD4jP2Jj23zF9Tiz+CONsJNdO1BrF1yqoaF/EWdEF9MWZrcZuBvSYjQb98Ffk5FiWXtGmaa//q1HFNnqtaucIrr0G8MnFoThygjbs81mjSQLi267oVxikbXxULGw=="}} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:23.943142 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.quota [None req-7cec2a1b-dadd-4bc6-a5ae-d67747cad8dd tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Getting quotas for project 6d2806e58f714af7a7f739a59d3dece1. Resources: {'key_pairs'} {{(pid=125165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:56:23.947112 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.quota [None req-7cec2a1b-dadd-4bc6-a5ae-d67747cad8dd tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Getting quotas for user a7c4228e92254a65ada3a0a777812103 and project 6d2806e58f714af7a7f739a59d3dece1. Resources: {'key_pairs'} {{(pid=125165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:56:23.970231 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-7cec2a1b-dadd-4bc6-a5ae-d67747cad8dd tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.216728 Oct 24 08:56:23.971074 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 436/879] 10.222.0.26 () {60 vars in 1159 bytes} [Mon Oct 24 08:56:23 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:23.986488 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-7ec9f545-0956-4f07-a272-123fdbc4d500 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:23.987071 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-7ec9f545-0956-4f07-a272-123fdbc4d500 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 83642ea6-d946-47b5-9d5a-e606cea14f3e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:23.995283 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7ec9f545-0956-4f07-a272-123fdbc4d500 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:23.996047 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7ec9f545-0956-4f07-a272-123fdbc4d500 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:23.996576 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7ec9f545-0956-4f07-a272-123fdbc4d500 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:23.997538 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7ec9f545-0956-4f07-a272-123fdbc4d500 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:23.998084 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7ec9f545-0956-4f07-a272-123fdbc4d500 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:23.998613 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-7ec9f545-0956-4f07-a272-123fdbc4d500 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:24.013324 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.wsgi [None req-7ec9f545-0956-4f07-a272-123fdbc4d500 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] HTTP exception thrown: Instance 83642ea6-d946-47b5-9d5a-e606cea14f3e could not be found. Oct 24 08:56:24.015365 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-7ec9f545-0956-4f07-a272-123fdbc4d500 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Request method failure captured: Oct 24 08:56:24.015365 dv-cinder-master-3-smb devstack@n-api.service[125164]: request: DELETE /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e HTTP/1.1 Oct 24 08:56:24.015365 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept: application/json Oct 24 08:56:24.015365 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept-Encoding: identity Oct 24 08:56:24.015365 dv-cinder-master-3-smb devstack@n-api.service[125164]: Connection: close Oct 24 08:56:24.015365 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Length: 0 Oct 24 08:56:24.015365 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Type: application/json Oct 24 08:56:24.015365 dv-cinder-master-3-smb devstack@n-api.service[125164]: Host: 10.222.0.26 Oct 24 08:56:24.015365 dv-cinder-master-3-smb devstack@n-api.service[125164]: Openstack-System-Scope: None Oct 24 08:56:24.015365 dv-cinder-master-3-smb devstack@n-api.service[125164]: User-Agent: python-urllib3/1.26.12 Oct 24 08:56:24.015365 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Auth-Token: gAAAAABjVlE2u8htP-0ukfebxjPQ_Tv08AEgRkqfcKErVq7KuTRTMT0ulC9K9eGWmc0J9Q6UTd3t0f_FhG9s34JNa-sHLE0_eBaC2GRhGdxZJM_viMU6wO-8X3T5-_M7hKYRa28fguCQkp2kM0S7f5w35MMqRh0sMsrU0PYXCVdXzPLgYLOBkKQ Oct 24 08:56:24.015365 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Id: None Oct 24 08:56:24.015365 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Name: None Oct 24 08:56:24.015365 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Identity-Status: Confirmed Oct 24 08:56:24.015365 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Is-Admin-Project: True Oct 24 08:56:24.015365 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Id: default Oct 24 08:56:24.015365 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Name: Default Oct 24 08:56:24.015365 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Id: 02be1b30677f400788b35b03938e44e5 Oct 24 08:56:24.015365 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Name: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:56:24.015365 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Role: reader,member Oct 24 08:56:24.015365 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Roles: reader,member Oct 24 08:56:24.016905 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_02be1b30677f400788b35b03938e44e5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/02be1b30677f400788b35b03938e44e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02be1b30677f400788b35b03938e44e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02be1b30677f400788b35b03938e44e5"}]}] Oct 24 08:56:24.016905 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:56:24.016905 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Id: 02be1b30677f400788b35b03938e44e5 Oct 24 08:56:24.016905 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:56:24.016905 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User: tempest-AttachVolumeNegativeTest-1868225476-project Oct 24 08:56:24.016905 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Id: default Oct 24 08:56:24.016905 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Name: Default Oct 24 08:56:24.016905 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Id: 712e5cf4cc004918817ab1802b9c69d6 Oct 24 08:56:24.016905 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Name: tempest-AttachVolumeNegativeTest-1868225476-project Oct 24 08:56:24.016905 dv-cinder-master-3-smb devstack@n-api.service[125164]: method: > Oct 24 08:56:24.016905 dv-cinder-master-3-smb devstack@n-api.service[125164]: exception: Instance 83642ea6-d946-47b5-9d5a-e606cea14f3e could not be found. Oct 24 08:56:24.016905 dv-cinder-master-3-smb devstack@n-api.service[125164]: action_args: {'id': '83642ea6-d946-47b5-9d5a-e606cea14f3e'} Oct 24 08:56:24.017841 dv-cinder-master-3-smb devstack@n-api.service[125164]: {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:56:24.017841 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:24.017841 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:56:24.017841 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:56:24.017841 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:56:24.017841 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:56:24.017841 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:56:24.017841 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:56:24.017841 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:56:24.017841 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:56:24.017841 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83642ea6-d946-47b5-9d5a-e606cea14f3e could not be found. Oct 24 08:56:24.017841 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:56:24.017841 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:24.017841 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:56:24.017841 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:24.017841 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:24.017841 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:24.017841 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:56:24.017841 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:56:24.017841 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:56:24.019230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:56:24.019230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 08:56:24.019230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 08:56:24.019230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 08:56:24.019230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 08:56:24.019230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:56:24.019230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:56:24.019230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:56:24.019230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:56:24.019230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83642ea6-d946-47b5-9d5a-e606cea14f3e could not be found. Oct 24 08:56:24.019230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:56:24.019230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:24.019230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:56:24.019230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:24.019230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:24.019230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:24.019230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:56:24.019230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:56:24.019230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83642ea6-d946-47b5-9d5a-e606cea14f3e could not be found. Oct 24 08:56:24.019230 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:56:24.020539 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-7ec9f545-0956-4f07-a272-123fdbc4d500 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Returning 404 to user: Instance 83642ea6-d946-47b5-9d5a-e606cea14f3e could not be found. {{(pid=125164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:56:24.020539 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-7ec9f545-0956-4f07-a272-123fdbc4d500 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "DELETE /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e" status: 404 len: 111 microversion: 2.1 time: 0.034115 Oct 24 08:56:24.020539 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 444/880] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Oct 24 08:56:23 2022] DELETE /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:56:24.027361 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-8c359ac1-5244-428e-8c8e-cdf579423e69 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:24.028243 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-8c359ac1-5244-428e-8c8e-cdf579423e69 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 83642ea6-d946-47b5-9d5a-e606cea14f3e] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:24.036734 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8c359ac1-5244-428e-8c8e-cdf579423e69 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:24.037499 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8c359ac1-5244-428e-8c8e-cdf579423e69 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:24.038067 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8c359ac1-5244-428e-8c8e-cdf579423e69 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:24.039138 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8c359ac1-5244-428e-8c8e-cdf579423e69 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:24.039745 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8c359ac1-5244-428e-8c8e-cdf579423e69 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:24.040328 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8c359ac1-5244-428e-8c8e-cdf579423e69 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:24.057733 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.wsgi [None req-8c359ac1-5244-428e-8c8e-cdf579423e69 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] HTTP exception thrown: Instance 83642ea6-d946-47b5-9d5a-e606cea14f3e could not be found. Oct 24 08:56:24.059465 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-8c359ac1-5244-428e-8c8e-cdf579423e69 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Request method failure captured: Oct 24 08:56:24.059465 dv-cinder-master-3-smb devstack@n-api.service[125165]: request: GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e HTTP/1.1 Oct 24 08:56:24.059465 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept: application/json Oct 24 08:56:24.059465 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept-Encoding: identity Oct 24 08:56:24.059465 dv-cinder-master-3-smb devstack@n-api.service[125165]: Connection: close Oct 24 08:56:24.059465 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Length: 0 Oct 24 08:56:24.059465 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Type: application/json Oct 24 08:56:24.059465 dv-cinder-master-3-smb devstack@n-api.service[125165]: Host: 10.222.0.26 Oct 24 08:56:24.059465 dv-cinder-master-3-smb devstack@n-api.service[125165]: Openstack-System-Scope: None Oct 24 08:56:24.059465 dv-cinder-master-3-smb devstack@n-api.service[125165]: User-Agent: python-urllib3/1.26.12 Oct 24 08:56:24.059465 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Auth-Token: gAAAAABjVlE2u8htP-0ukfebxjPQ_Tv08AEgRkqfcKErVq7KuTRTMT0ulC9K9eGWmc0J9Q6UTd3t0f_FhG9s34JNa-sHLE0_eBaC2GRhGdxZJM_viMU6wO-8X3T5-_M7hKYRa28fguCQkp2kM0S7f5w35MMqRh0sMsrU0PYXCVdXzPLgYLOBkKQ Oct 24 08:56:24.059465 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Id: None Oct 24 08:56:24.059465 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Name: None Oct 24 08:56:24.059465 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Identity-Status: Confirmed Oct 24 08:56:24.059465 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Is-Admin-Project: True Oct 24 08:56:24.059465 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Id: default Oct 24 08:56:24.059465 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Name: Default Oct 24 08:56:24.059465 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Id: 02be1b30677f400788b35b03938e44e5 Oct 24 08:56:24.059465 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Name: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:56:24.059465 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Role: reader,member Oct 24 08:56:24.059465 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Roles: reader,member Oct 24 08:56:24.060960 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_02be1b30677f400788b35b03938e44e5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/02be1b30677f400788b35b03938e44e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02be1b30677f400788b35b03938e44e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02be1b30677f400788b35b03938e44e5"}]}] Oct 24 08:56:24.060960 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:56:24.060960 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Id: 02be1b30677f400788b35b03938e44e5 Oct 24 08:56:24.060960 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:56:24.060960 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User: tempest-AttachVolumeNegativeTest-1868225476-project Oct 24 08:56:24.060960 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Id: default Oct 24 08:56:24.060960 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Name: Default Oct 24 08:56:24.060960 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Id: 712e5cf4cc004918817ab1802b9c69d6 Oct 24 08:56:24.060960 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Name: tempest-AttachVolumeNegativeTest-1868225476-project Oct 24 08:56:24.060960 dv-cinder-master-3-smb devstack@n-api.service[125165]: method: > Oct 24 08:56:24.060960 dv-cinder-master-3-smb devstack@n-api.service[125165]: exception: Instance 83642ea6-d946-47b5-9d5a-e606cea14f3e could not be found. Oct 24 08:56:24.060960 dv-cinder-master-3-smb devstack@n-api.service[125165]: action_args: {'id': '83642ea6-d946-47b5-9d5a-e606cea14f3e'} Oct 24 08:56:24.061753 dv-cinder-master-3-smb devstack@n-api.service[125165]: {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:56:24.061753 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:24.061753 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:56:24.061753 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:56:24.061753 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:56:24.061753 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:56:24.061753 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:56:24.061753 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:56:24.061753 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:56:24.061753 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:56:24.061753 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83642ea6-d946-47b5-9d5a-e606cea14f3e could not be found. Oct 24 08:56:24.061753 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:56:24.061753 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:24.061753 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:56:24.061753 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:24.061753 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:24.061753 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:24.061753 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:56:24.061753 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:56:24.061753 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:56:24.063625 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:56:24.063625 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:56:24.063625 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:56:24.063625 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:56:24.063625 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:56:24.063625 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:56:24.063625 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:56:24.063625 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83642ea6-d946-47b5-9d5a-e606cea14f3e could not be found. Oct 24 08:56:24.063625 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:56:24.063625 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:24.063625 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:56:24.063625 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:24.063625 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:24.063625 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:24.063625 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:56:24.063625 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:56:24.063625 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83642ea6-d946-47b5-9d5a-e606cea14f3e could not be found. Oct 24 08:56:24.063625 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:56:24.065290 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-8c359ac1-5244-428e-8c8e-cdf579423e69 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Returning 404 to user: Instance 83642ea6-d946-47b5-9d5a-e606cea14f3e could not be found. {{(pid=125165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:56:24.065290 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-8c359ac1-5244-428e-8c8e-cdf579423e69 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e" status: 404 len: 111 microversion: 2.1 time: 0.038510 Oct 24 08:56:24.065290 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 437/881] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:24 2022] GET /compute/v2.1/servers/83642ea6-d946-47b5-9d5a-e606cea14f3e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:56:25.219579 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-e5bb5be9-8325-4f84-95a1-1a90b4f79a6d tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:25.220922 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-e5bb5be9-8325-4f84-95a1-1a90b4f79a6d tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 9ba684f7-ce77-465c-a6d7-7840517ef487] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:25.227903 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e5bb5be9-8325-4f84-95a1-1a90b4f79a6d tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:25.228592 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e5bb5be9-8325-4f84-95a1-1a90b4f79a6d tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:25.229177 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e5bb5be9-8325-4f84-95a1-1a90b4f79a6d tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:25.230062 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e5bb5be9-8325-4f84-95a1-1a90b4f79a6d tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:25.230963 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e5bb5be9-8325-4f84-95a1-1a90b4f79a6d tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:25.231548 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e5bb5be9-8325-4f84-95a1-1a90b4f79a6d tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:25.246962 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.wsgi [None req-e5bb5be9-8325-4f84-95a1-1a90b4f79a6d tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] HTTP exception thrown: Instance 9ba684f7-ce77-465c-a6d7-7840517ef487 could not be found. Oct 24 08:56:25.248712 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-e5bb5be9-8325-4f84-95a1-1a90b4f79a6d tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Request method failure captured: Oct 24 08:56:25.248712 dv-cinder-master-3-smb devstack@n-api.service[125164]: request: DELETE /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487 HTTP/1.1 Oct 24 08:56:25.248712 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept: application/json Oct 24 08:56:25.248712 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept-Encoding: identity Oct 24 08:56:25.248712 dv-cinder-master-3-smb devstack@n-api.service[125164]: Connection: close Oct 24 08:56:25.248712 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Length: 0 Oct 24 08:56:25.248712 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Type: application/json Oct 24 08:56:25.248712 dv-cinder-master-3-smb devstack@n-api.service[125164]: Host: 10.222.0.26 Oct 24 08:56:25.248712 dv-cinder-master-3-smb devstack@n-api.service[125164]: Openstack-System-Scope: None Oct 24 08:56:25.248712 dv-cinder-master-3-smb devstack@n-api.service[125164]: User-Agent: python-urllib3/1.26.12 Oct 24 08:56:25.248712 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Auth-Token: gAAAAABjVlE2u8htP-0ukfebxjPQ_Tv08AEgRkqfcKErVq7KuTRTMT0ulC9K9eGWmc0J9Q6UTd3t0f_FhG9s34JNa-sHLE0_eBaC2GRhGdxZJM_viMU6wO-8X3T5-_M7hKYRa28fguCQkp2kM0S7f5w35MMqRh0sMsrU0PYXCVdXzPLgYLOBkKQ Oct 24 08:56:25.248712 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Id: None Oct 24 08:56:25.248712 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Name: None Oct 24 08:56:25.248712 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Identity-Status: Confirmed Oct 24 08:56:25.248712 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Is-Admin-Project: True Oct 24 08:56:25.248712 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Id: default Oct 24 08:56:25.248712 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Name: Default Oct 24 08:56:25.248712 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Id: 02be1b30677f400788b35b03938e44e5 Oct 24 08:56:25.248712 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Name: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:56:25.248712 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Role: reader,member Oct 24 08:56:25.248712 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Roles: reader,member Oct 24 08:56:25.250359 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_02be1b30677f400788b35b03938e44e5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/02be1b30677f400788b35b03938e44e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02be1b30677f400788b35b03938e44e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02be1b30677f400788b35b03938e44e5"}]}] Oct 24 08:56:25.250359 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:56:25.250359 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Id: 02be1b30677f400788b35b03938e44e5 Oct 24 08:56:25.250359 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:56:25.250359 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User: tempest-AttachVolumeNegativeTest-1868225476-project Oct 24 08:56:25.250359 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Id: default Oct 24 08:56:25.250359 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Name: Default Oct 24 08:56:25.250359 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Id: 712e5cf4cc004918817ab1802b9c69d6 Oct 24 08:56:25.250359 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Name: tempest-AttachVolumeNegativeTest-1868225476-project Oct 24 08:56:25.250359 dv-cinder-master-3-smb devstack@n-api.service[125164]: method: > Oct 24 08:56:25.250359 dv-cinder-master-3-smb devstack@n-api.service[125164]: exception: Instance 9ba684f7-ce77-465c-a6d7-7840517ef487 could not be found. Oct 24 08:56:25.250359 dv-cinder-master-3-smb devstack@n-api.service[125164]: action_args: {'id': '9ba684f7-ce77-465c-a6d7-7840517ef487'} Oct 24 08:56:25.251349 dv-cinder-master-3-smb devstack@n-api.service[125164]: {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:56:25.251349 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:25.251349 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:56:25.251349 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:56:25.251349 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:56:25.251349 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:56:25.251349 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:56:25.251349 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:56:25.251349 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:56:25.251349 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:56:25.251349 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ba684f7-ce77-465c-a6d7-7840517ef487 could not be found. Oct 24 08:56:25.251349 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:56:25.251349 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:25.251349 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:56:25.251349 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:25.251349 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:25.251349 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:25.251349 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:56:25.251349 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:56:25.251349 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:56:25.252889 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:56:25.252889 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 08:56:25.252889 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 08:56:25.252889 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 08:56:25.252889 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 08:56:25.252889 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:56:25.252889 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:56:25.252889 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:56:25.252889 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:56:25.252889 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ba684f7-ce77-465c-a6d7-7840517ef487 could not be found. Oct 24 08:56:25.252889 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:56:25.252889 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:25.252889 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:56:25.252889 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:25.252889 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:25.252889 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:25.252889 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:56:25.252889 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:56:25.252889 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ba684f7-ce77-465c-a6d7-7840517ef487 could not be found. Oct 24 08:56:25.252889 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:56:25.255719 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-e5bb5be9-8325-4f84-95a1-1a90b4f79a6d tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Returning 404 to user: Instance 9ba684f7-ce77-465c-a6d7-7840517ef487 could not be found. {{(pid=125164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:56:25.256856 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-e5bb5be9-8325-4f84-95a1-1a90b4f79a6d tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487" status: 404 len: 111 microversion: 2.1 time: 0.041126 Oct 24 08:56:25.257878 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 445/882] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Oct 24 08:56:25 2022] DELETE /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:56:25.268402 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-8dac0031-b0da-4450-9e5f-2587525d6de2 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:25.269019 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-8dac0031-b0da-4450-9e5f-2587525d6de2 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 9ba684f7-ce77-465c-a6d7-7840517ef487] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:25.276940 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8dac0031-b0da-4450-9e5f-2587525d6de2 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:25.277433 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8dac0031-b0da-4450-9e5f-2587525d6de2 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:25.277867 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8dac0031-b0da-4450-9e5f-2587525d6de2 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:25.278886 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8dac0031-b0da-4450-9e5f-2587525d6de2 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:25.279885 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8dac0031-b0da-4450-9e5f-2587525d6de2 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:25.280464 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-8dac0031-b0da-4450-9e5f-2587525d6de2 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:25.299411 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.wsgi [None req-8dac0031-b0da-4450-9e5f-2587525d6de2 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] HTTP exception thrown: Instance 9ba684f7-ce77-465c-a6d7-7840517ef487 could not be found. Oct 24 08:56:25.301274 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-8dac0031-b0da-4450-9e5f-2587525d6de2 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Request method failure captured: Oct 24 08:56:25.301274 dv-cinder-master-3-smb devstack@n-api.service[125165]: request: GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487 HTTP/1.1 Oct 24 08:56:25.301274 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept: application/json Oct 24 08:56:25.301274 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept-Encoding: identity Oct 24 08:56:25.301274 dv-cinder-master-3-smb devstack@n-api.service[125165]: Connection: close Oct 24 08:56:25.301274 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Length: 0 Oct 24 08:56:25.301274 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Type: application/json Oct 24 08:56:25.301274 dv-cinder-master-3-smb devstack@n-api.service[125165]: Host: 10.222.0.26 Oct 24 08:56:25.301274 dv-cinder-master-3-smb devstack@n-api.service[125165]: Openstack-System-Scope: None Oct 24 08:56:25.301274 dv-cinder-master-3-smb devstack@n-api.service[125165]: User-Agent: python-urllib3/1.26.12 Oct 24 08:56:25.301274 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Auth-Token: gAAAAABjVlE2u8htP-0ukfebxjPQ_Tv08AEgRkqfcKErVq7KuTRTMT0ulC9K9eGWmc0J9Q6UTd3t0f_FhG9s34JNa-sHLE0_eBaC2GRhGdxZJM_viMU6wO-8X3T5-_M7hKYRa28fguCQkp2kM0S7f5w35MMqRh0sMsrU0PYXCVdXzPLgYLOBkKQ Oct 24 08:56:25.301274 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Id: None Oct 24 08:56:25.301274 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Name: None Oct 24 08:56:25.301274 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Identity-Status: Confirmed Oct 24 08:56:25.301274 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Is-Admin-Project: True Oct 24 08:56:25.301274 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Id: default Oct 24 08:56:25.301274 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Name: Default Oct 24 08:56:25.301274 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Id: 02be1b30677f400788b35b03938e44e5 Oct 24 08:56:25.301274 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Name: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:56:25.301274 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Role: reader,member Oct 24 08:56:25.301274 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Roles: reader,member Oct 24 08:56:25.302911 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_02be1b30677f400788b35b03938e44e5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/02be1b30677f400788b35b03938e44e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02be1b30677f400788b35b03938e44e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02be1b30677f400788b35b03938e44e5"}]}] Oct 24 08:56:25.302911 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:56:25.302911 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Id: 02be1b30677f400788b35b03938e44e5 Oct 24 08:56:25.302911 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:56:25.302911 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User: tempest-AttachVolumeNegativeTest-1868225476-project Oct 24 08:56:25.302911 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Id: default Oct 24 08:56:25.302911 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Name: Default Oct 24 08:56:25.302911 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Id: 712e5cf4cc004918817ab1802b9c69d6 Oct 24 08:56:25.302911 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Name: tempest-AttachVolumeNegativeTest-1868225476-project Oct 24 08:56:25.302911 dv-cinder-master-3-smb devstack@n-api.service[125165]: method: > Oct 24 08:56:25.302911 dv-cinder-master-3-smb devstack@n-api.service[125165]: exception: Instance 9ba684f7-ce77-465c-a6d7-7840517ef487 could not be found. Oct 24 08:56:25.302911 dv-cinder-master-3-smb devstack@n-api.service[125165]: action_args: {'id': '9ba684f7-ce77-465c-a6d7-7840517ef487'} Oct 24 08:56:25.303814 dv-cinder-master-3-smb devstack@n-api.service[125165]: {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:56:25.303814 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:25.303814 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:56:25.303814 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:56:25.303814 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:56:25.303814 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:56:25.303814 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:56:25.303814 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:56:25.303814 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:56:25.303814 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:56:25.303814 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ba684f7-ce77-465c-a6d7-7840517ef487 could not be found. Oct 24 08:56:25.303814 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:56:25.303814 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:25.303814 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:56:25.303814 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:25.303814 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:25.303814 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:25.303814 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:56:25.303814 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:56:25.303814 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:56:25.305455 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:56:25.305455 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:56:25.305455 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:56:25.305455 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:56:25.305455 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:56:25.305455 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:56:25.305455 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:56:25.305455 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ba684f7-ce77-465c-a6d7-7840517ef487 could not be found. Oct 24 08:56:25.305455 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:56:25.305455 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:25.305455 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:56:25.305455 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:25.305455 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:25.305455 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:25.305455 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:56:25.305455 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:56:25.305455 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ba684f7-ce77-465c-a6d7-7840517ef487 could not be found. Oct 24 08:56:25.305455 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:56:25.307898 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-8dac0031-b0da-4450-9e5f-2587525d6de2 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Returning 404 to user: Instance 9ba684f7-ce77-465c-a6d7-7840517ef487 could not be found. {{(pid=125165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:56:25.308909 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-8dac0031-b0da-4450-9e5f-2587525d6de2 tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487" status: 404 len: 111 microversion: 2.1 time: 0.046180 Oct 24 08:56:25.318208 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-3c8179d5-d3b6-4fc0-b21f-0d85b6e0645a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:25.319016 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-3c8179d5-d3b6-4fc0-b21f-0d85b6e0645a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 880d7b45-efa0-4aec-9342-b84795db3c74] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:25.321812 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 438/883] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:25 2022] GET /compute/v2.1/servers/9ba684f7-ce77-465c-a6d7-7840517ef487 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:56:25.325092 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3c8179d5-d3b6-4fc0-b21f-0d85b6e0645a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:25.325918 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3c8179d5-d3b6-4fc0-b21f-0d85b6e0645a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:25.326543 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3c8179d5-d3b6-4fc0-b21f-0d85b6e0645a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:25.328670 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3c8179d5-d3b6-4fc0-b21f-0d85b6e0645a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:25.329959 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3c8179d5-d3b6-4fc0-b21f-0d85b6e0645a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:25.330618 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3c8179d5-d3b6-4fc0-b21f-0d85b6e0645a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:25.347271 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.wsgi [None req-3c8179d5-d3b6-4fc0-b21f-0d85b6e0645a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] HTTP exception thrown: Instance 880d7b45-efa0-4aec-9342-b84795db3c74 could not be found. Oct 24 08:56:25.349099 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-3c8179d5-d3b6-4fc0-b21f-0d85b6e0645a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Request method failure captured: Oct 24 08:56:25.349099 dv-cinder-master-3-smb devstack@n-api.service[125164]: request: DELETE /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74 HTTP/1.1 Oct 24 08:56:25.349099 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept: application/json Oct 24 08:56:25.349099 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept-Encoding: identity Oct 24 08:56:25.349099 dv-cinder-master-3-smb devstack@n-api.service[125164]: Connection: close Oct 24 08:56:25.349099 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Length: 0 Oct 24 08:56:25.349099 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Type: application/json Oct 24 08:56:25.349099 dv-cinder-master-3-smb devstack@n-api.service[125164]: Host: 10.222.0.26 Oct 24 08:56:25.349099 dv-cinder-master-3-smb devstack@n-api.service[125164]: Openstack-System-Scope: None Oct 24 08:56:25.349099 dv-cinder-master-3-smb devstack@n-api.service[125164]: User-Agent: python-urllib3/1.26.12 Oct 24 08:56:25.349099 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Auth-Token: gAAAAABjVlE2u8htP-0ukfebxjPQ_Tv08AEgRkqfcKErVq7KuTRTMT0ulC9K9eGWmc0J9Q6UTd3t0f_FhG9s34JNa-sHLE0_eBaC2GRhGdxZJM_viMU6wO-8X3T5-_M7hKYRa28fguCQkp2kM0S7f5w35MMqRh0sMsrU0PYXCVdXzPLgYLOBkKQ Oct 24 08:56:25.349099 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Id: None Oct 24 08:56:25.349099 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Name: None Oct 24 08:56:25.349099 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Identity-Status: Confirmed Oct 24 08:56:25.349099 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Is-Admin-Project: True Oct 24 08:56:25.349099 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Id: default Oct 24 08:56:25.349099 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Name: Default Oct 24 08:56:25.349099 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Id: 02be1b30677f400788b35b03938e44e5 Oct 24 08:56:25.349099 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Name: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:56:25.349099 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Role: reader,member Oct 24 08:56:25.349099 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Roles: reader,member Oct 24 08:56:25.350465 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_02be1b30677f400788b35b03938e44e5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/02be1b30677f400788b35b03938e44e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02be1b30677f400788b35b03938e44e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02be1b30677f400788b35b03938e44e5"}]}] Oct 24 08:56:25.350465 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:56:25.350465 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Id: 02be1b30677f400788b35b03938e44e5 Oct 24 08:56:25.350465 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:56:25.350465 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User: tempest-AttachVolumeNegativeTest-1868225476-project Oct 24 08:56:25.350465 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Id: default Oct 24 08:56:25.350465 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Name: Default Oct 24 08:56:25.350465 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Id: 712e5cf4cc004918817ab1802b9c69d6 Oct 24 08:56:25.350465 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Name: tempest-AttachVolumeNegativeTest-1868225476-project Oct 24 08:56:25.350465 dv-cinder-master-3-smb devstack@n-api.service[125164]: method: > Oct 24 08:56:25.350465 dv-cinder-master-3-smb devstack@n-api.service[125164]: exception: Instance 880d7b45-efa0-4aec-9342-b84795db3c74 could not be found. Oct 24 08:56:25.350465 dv-cinder-master-3-smb devstack@n-api.service[125164]: action_args: {'id': '880d7b45-efa0-4aec-9342-b84795db3c74'} Oct 24 08:56:25.351273 dv-cinder-master-3-smb devstack@n-api.service[125164]: {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:56:25.351273 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:25.351273 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:56:25.351273 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:56:25.351273 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:56:25.351273 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:56:25.351273 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:56:25.351273 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:56:25.351273 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:56:25.351273 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:56:25.351273 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 880d7b45-efa0-4aec-9342-b84795db3c74 could not be found. Oct 24 08:56:25.351273 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:56:25.351273 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:25.351273 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:56:25.351273 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:25.351273 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:25.351273 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:25.351273 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:56:25.351273 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:56:25.351273 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:56:25.353213 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:56:25.353213 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 08:56:25.353213 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 08:56:25.353213 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 08:56:25.353213 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 08:56:25.353213 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:56:25.353213 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:56:25.353213 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:56:25.353213 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:56:25.353213 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 880d7b45-efa0-4aec-9342-b84795db3c74 could not be found. Oct 24 08:56:25.353213 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:56:25.353213 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:25.353213 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:56:25.353213 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:25.353213 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:25.353213 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:25.353213 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:56:25.353213 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:56:25.353213 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 880d7b45-efa0-4aec-9342-b84795db3c74 could not be found. Oct 24 08:56:25.353213 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:56:25.355417 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-3c8179d5-d3b6-4fc0-b21f-0d85b6e0645a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Returning 404 to user: Instance 880d7b45-efa0-4aec-9342-b84795db3c74 could not be found. {{(pid=125164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:56:25.355417 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-3c8179d5-d3b6-4fc0-b21f-0d85b6e0645a tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "DELETE /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74" status: 404 len: 111 microversion: 2.1 time: 0.039834 Oct 24 08:56:25.356596 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 446/884] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Oct 24 08:56:25 2022] DELETE /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:56:25.366010 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-09a27db2-23d2-4277-863c-1f151e00c65c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:25.366754 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-09a27db2-23d2-4277-863c-1f151e00c65c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: 880d7b45-efa0-4aec-9342-b84795db3c74] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:25.374251 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-09a27db2-23d2-4277-863c-1f151e00c65c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:25.374929 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-09a27db2-23d2-4277-863c-1f151e00c65c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:25.375552 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-09a27db2-23d2-4277-863c-1f151e00c65c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:25.376686 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-09a27db2-23d2-4277-863c-1f151e00c65c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:25.377418 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-09a27db2-23d2-4277-863c-1f151e00c65c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:25.378090 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-09a27db2-23d2-4277-863c-1f151e00c65c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:25.394274 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.wsgi [None req-09a27db2-23d2-4277-863c-1f151e00c65c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] HTTP exception thrown: Instance 880d7b45-efa0-4aec-9342-b84795db3c74 could not be found. Oct 24 08:56:25.395844 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-09a27db2-23d2-4277-863c-1f151e00c65c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Request method failure captured: Oct 24 08:56:25.395844 dv-cinder-master-3-smb devstack@n-api.service[125165]: request: GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74 HTTP/1.1 Oct 24 08:56:25.395844 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept: application/json Oct 24 08:56:25.395844 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept-Encoding: identity Oct 24 08:56:25.395844 dv-cinder-master-3-smb devstack@n-api.service[125165]: Connection: close Oct 24 08:56:25.395844 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Length: 0 Oct 24 08:56:25.395844 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Type: application/json Oct 24 08:56:25.395844 dv-cinder-master-3-smb devstack@n-api.service[125165]: Host: 10.222.0.26 Oct 24 08:56:25.395844 dv-cinder-master-3-smb devstack@n-api.service[125165]: Openstack-System-Scope: None Oct 24 08:56:25.395844 dv-cinder-master-3-smb devstack@n-api.service[125165]: User-Agent: python-urllib3/1.26.12 Oct 24 08:56:25.395844 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Auth-Token: gAAAAABjVlE2u8htP-0ukfebxjPQ_Tv08AEgRkqfcKErVq7KuTRTMT0ulC9K9eGWmc0J9Q6UTd3t0f_FhG9s34JNa-sHLE0_eBaC2GRhGdxZJM_viMU6wO-8X3T5-_M7hKYRa28fguCQkp2kM0S7f5w35MMqRh0sMsrU0PYXCVdXzPLgYLOBkKQ Oct 24 08:56:25.395844 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Id: None Oct 24 08:56:25.395844 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Name: None Oct 24 08:56:25.395844 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Identity-Status: Confirmed Oct 24 08:56:25.395844 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Is-Admin-Project: True Oct 24 08:56:25.395844 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Id: default Oct 24 08:56:25.395844 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Name: Default Oct 24 08:56:25.395844 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Id: 02be1b30677f400788b35b03938e44e5 Oct 24 08:56:25.395844 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Name: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:56:25.395844 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Role: reader,member Oct 24 08:56:25.395844 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Roles: reader,member Oct 24 08:56:25.397508 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_02be1b30677f400788b35b03938e44e5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/02be1b30677f400788b35b03938e44e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02be1b30677f400788b35b03938e44e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02be1b30677f400788b35b03938e44e5"}]}] Oct 24 08:56:25.397508 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:56:25.397508 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Id: 02be1b30677f400788b35b03938e44e5 Oct 24 08:56:25.397508 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:56:25.397508 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User: tempest-AttachVolumeNegativeTest-1868225476-project Oct 24 08:56:25.397508 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Id: default Oct 24 08:56:25.397508 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Name: Default Oct 24 08:56:25.397508 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Id: 712e5cf4cc004918817ab1802b9c69d6 Oct 24 08:56:25.397508 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Name: tempest-AttachVolumeNegativeTest-1868225476-project Oct 24 08:56:25.397508 dv-cinder-master-3-smb devstack@n-api.service[125165]: method: > Oct 24 08:56:25.397508 dv-cinder-master-3-smb devstack@n-api.service[125165]: exception: Instance 880d7b45-efa0-4aec-9342-b84795db3c74 could not be found. Oct 24 08:56:25.397508 dv-cinder-master-3-smb devstack@n-api.service[125165]: action_args: {'id': '880d7b45-efa0-4aec-9342-b84795db3c74'} Oct 24 08:56:25.398340 dv-cinder-master-3-smb devstack@n-api.service[125165]: {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:56:25.398340 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:25.398340 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:56:25.398340 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:56:25.398340 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:56:25.398340 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:56:25.398340 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:56:25.398340 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:56:25.398340 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:56:25.398340 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:56:25.398340 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 880d7b45-efa0-4aec-9342-b84795db3c74 could not be found. Oct 24 08:56:25.398340 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:56:25.398340 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:25.398340 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:56:25.398340 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:25.398340 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:25.398340 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:25.398340 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:56:25.398340 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:56:25.398340 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:56:25.399816 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:56:25.399816 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:56:25.399816 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:56:25.399816 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:56:25.399816 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:56:25.399816 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:56:25.399816 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:56:25.399816 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 880d7b45-efa0-4aec-9342-b84795db3c74 could not be found. Oct 24 08:56:25.399816 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:56:25.399816 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:25.399816 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:56:25.399816 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:25.399816 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:25.399816 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:25.399816 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:56:25.399816 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:56:25.399816 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 880d7b45-efa0-4aec-9342-b84795db3c74 could not be found. Oct 24 08:56:25.399816 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:56:25.401106 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-09a27db2-23d2-4277-863c-1f151e00c65c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Returning 404 to user: Instance 880d7b45-efa0-4aec-9342-b84795db3c74 could not be found. {{(pid=125165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:56:25.401106 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-09a27db2-23d2-4277-863c-1f151e00c65c tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74" status: 404 len: 111 microversion: 2.1 time: 0.035998 Oct 24 08:56:25.401106 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 439/885] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:25 2022] GET /compute/v2.1/servers/880d7b45-efa0-4aec-9342-b84795db3c74 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:56:26.569838 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-12d5650d-3d08-454b-8945-ba0c36a0557e tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:26.571025 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-12d5650d-3d08-454b-8945-ba0c36a0557e tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:26.579494 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-12d5650d-3d08-454b-8945-ba0c36a0557e tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:26.580053 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-12d5650d-3d08-454b-8945-ba0c36a0557e tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:26.580610 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-12d5650d-3d08-454b-8945-ba0c36a0557e tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:26.581426 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-12d5650d-3d08-454b-8945-ba0c36a0557e tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:26.582321 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-12d5650d-3d08-454b-8945-ba0c36a0557e tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:26.582833 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-12d5650d-3d08-454b-8945-ba0c36a0557e tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:26.599544 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.wsgi [None req-12d5650d-3d08-454b-8945-ba0c36a0557e tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] HTTP exception thrown: Instance f6890641-4753-4fb7-86a4-fb5782b1b5b1 could not be found. Oct 24 08:56:26.601122 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-12d5650d-3d08-454b-8945-ba0c36a0557e tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Request method failure captured: Oct 24 08:56:26.601122 dv-cinder-master-3-smb devstack@n-api.service[125164]: request: DELETE /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 HTTP/1.1 Oct 24 08:56:26.601122 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept: application/json Oct 24 08:56:26.601122 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept-Encoding: identity Oct 24 08:56:26.601122 dv-cinder-master-3-smb devstack@n-api.service[125164]: Connection: close Oct 24 08:56:26.601122 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Length: 0 Oct 24 08:56:26.601122 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Type: application/json Oct 24 08:56:26.601122 dv-cinder-master-3-smb devstack@n-api.service[125164]: Host: 10.222.0.26 Oct 24 08:56:26.601122 dv-cinder-master-3-smb devstack@n-api.service[125164]: Openstack-System-Scope: None Oct 24 08:56:26.601122 dv-cinder-master-3-smb devstack@n-api.service[125164]: User-Agent: python-urllib3/1.26.12 Oct 24 08:56:26.601122 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Auth-Token: gAAAAABjVlE2u8htP-0ukfebxjPQ_Tv08AEgRkqfcKErVq7KuTRTMT0ulC9K9eGWmc0J9Q6UTd3t0f_FhG9s34JNa-sHLE0_eBaC2GRhGdxZJM_viMU6wO-8X3T5-_M7hKYRa28fguCQkp2kM0S7f5w35MMqRh0sMsrU0PYXCVdXzPLgYLOBkKQ Oct 24 08:56:26.601122 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Id: None Oct 24 08:56:26.601122 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Name: None Oct 24 08:56:26.601122 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Identity-Status: Confirmed Oct 24 08:56:26.601122 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Is-Admin-Project: True Oct 24 08:56:26.601122 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Id: default Oct 24 08:56:26.601122 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Name: Default Oct 24 08:56:26.601122 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Id: 02be1b30677f400788b35b03938e44e5 Oct 24 08:56:26.601122 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Name: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:56:26.601122 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Role: reader,member Oct 24 08:56:26.601122 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Roles: reader,member Oct 24 08:56:26.602855 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_02be1b30677f400788b35b03938e44e5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/02be1b30677f400788b35b03938e44e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02be1b30677f400788b35b03938e44e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02be1b30677f400788b35b03938e44e5"}]}] Oct 24 08:56:26.602855 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:56:26.602855 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Id: 02be1b30677f400788b35b03938e44e5 Oct 24 08:56:26.602855 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:56:26.602855 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User: tempest-AttachVolumeNegativeTest-1868225476-project Oct 24 08:56:26.602855 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Id: default Oct 24 08:56:26.602855 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Name: Default Oct 24 08:56:26.602855 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Id: 712e5cf4cc004918817ab1802b9c69d6 Oct 24 08:56:26.602855 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Name: tempest-AttachVolumeNegativeTest-1868225476-project Oct 24 08:56:26.602855 dv-cinder-master-3-smb devstack@n-api.service[125164]: method: > Oct 24 08:56:26.602855 dv-cinder-master-3-smb devstack@n-api.service[125164]: exception: Instance f6890641-4753-4fb7-86a4-fb5782b1b5b1 could not be found. Oct 24 08:56:26.602855 dv-cinder-master-3-smb devstack@n-api.service[125164]: action_args: {'id': 'f6890641-4753-4fb7-86a4-fb5782b1b5b1'} Oct 24 08:56:26.606932 dv-cinder-master-3-smb devstack@n-api.service[125164]: {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:56:26.606932 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:26.606932 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:56:26.606932 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:56:26.606932 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:56:26.606932 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:56:26.606932 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:56:26.606932 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:56:26.606932 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:56:26.606932 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:56:26.606932 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6890641-4753-4fb7-86a4-fb5782b1b5b1 could not be found. Oct 24 08:56:26.606932 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:56:26.606932 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:26.606932 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:56:26.606932 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:26.606932 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:26.606932 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:26.606932 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:56:26.606932 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:56:26.606932 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:56:26.608258 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:56:26.608258 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 08:56:26.608258 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 08:56:26.608258 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 08:56:26.608258 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 08:56:26.608258 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:56:26.608258 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:56:26.608258 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:56:26.608258 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:56:26.608258 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6890641-4753-4fb7-86a4-fb5782b1b5b1 could not be found. Oct 24 08:56:26.608258 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:56:26.608258 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:26.608258 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:56:26.608258 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:26.608258 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:26.608258 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:26.608258 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:56:26.608258 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:56:26.608258 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6890641-4753-4fb7-86a4-fb5782b1b5b1 could not be found. Oct 24 08:56:26.608258 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:56:26.609444 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-12d5650d-3d08-454b-8945-ba0c36a0557e tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Returning 404 to user: Instance f6890641-4753-4fb7-86a4-fb5782b1b5b1 could not be found. {{(pid=125164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:56:26.609444 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-12d5650d-3d08-454b-8945-ba0c36a0557e tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1" status: 404 len: 111 microversion: 2.1 time: 0.036582 Oct 24 08:56:26.609444 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 447/886] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Oct 24 08:56:26 2022] DELETE /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:56:26.611850 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-a8b5f8fe-afa5-4a87-b510-1a06a8bdbe5e tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:26.612492 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-a8b5f8fe-afa5-4a87-b510-1a06a8bdbe5e tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] [instance: f6890641-4753-4fb7-86a4-fb5782b1b5b1] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:26.619263 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a8b5f8fe-afa5-4a87-b510-1a06a8bdbe5e tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:26.619762 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a8b5f8fe-afa5-4a87-b510-1a06a8bdbe5e tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:26.620193 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a8b5f8fe-afa5-4a87-b510-1a06a8bdbe5e tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:26.620892 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a8b5f8fe-afa5-4a87-b510-1a06a8bdbe5e tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:26.621342 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a8b5f8fe-afa5-4a87-b510-1a06a8bdbe5e tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:26.621756 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a8b5f8fe-afa5-4a87-b510-1a06a8bdbe5e tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:26.637250 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.wsgi [None req-a8b5f8fe-afa5-4a87-b510-1a06a8bdbe5e tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] HTTP exception thrown: Instance f6890641-4753-4fb7-86a4-fb5782b1b5b1 could not be found. Oct 24 08:56:26.638652 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-a8b5f8fe-afa5-4a87-b510-1a06a8bdbe5e tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Request method failure captured: Oct 24 08:56:26.638652 dv-cinder-master-3-smb devstack@n-api.service[125165]: request: GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 HTTP/1.1 Oct 24 08:56:26.638652 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept: application/json Oct 24 08:56:26.638652 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept-Encoding: identity Oct 24 08:56:26.638652 dv-cinder-master-3-smb devstack@n-api.service[125165]: Connection: close Oct 24 08:56:26.638652 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Length: 0 Oct 24 08:56:26.638652 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Type: application/json Oct 24 08:56:26.638652 dv-cinder-master-3-smb devstack@n-api.service[125165]: Host: 10.222.0.26 Oct 24 08:56:26.638652 dv-cinder-master-3-smb devstack@n-api.service[125165]: Openstack-System-Scope: None Oct 24 08:56:26.638652 dv-cinder-master-3-smb devstack@n-api.service[125165]: User-Agent: python-urllib3/1.26.12 Oct 24 08:56:26.638652 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Auth-Token: gAAAAABjVlE2u8htP-0ukfebxjPQ_Tv08AEgRkqfcKErVq7KuTRTMT0ulC9K9eGWmc0J9Q6UTd3t0f_FhG9s34JNa-sHLE0_eBaC2GRhGdxZJM_viMU6wO-8X3T5-_M7hKYRa28fguCQkp2kM0S7f5w35MMqRh0sMsrU0PYXCVdXzPLgYLOBkKQ Oct 24 08:56:26.638652 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Id: None Oct 24 08:56:26.638652 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Name: None Oct 24 08:56:26.638652 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Identity-Status: Confirmed Oct 24 08:56:26.638652 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Is-Admin-Project: True Oct 24 08:56:26.638652 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Id: default Oct 24 08:56:26.638652 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Name: Default Oct 24 08:56:26.638652 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Id: 02be1b30677f400788b35b03938e44e5 Oct 24 08:56:26.638652 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Name: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:56:26.638652 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Role: reader,member Oct 24 08:56:26.638652 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Roles: reader,member Oct 24 08:56:26.640086 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_02be1b30677f400788b35b03938e44e5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/02be1b30677f400788b35b03938e44e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02be1b30677f400788b35b03938e44e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02be1b30677f400788b35b03938e44e5"}]}] Oct 24 08:56:26.640086 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:56:26.640086 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Id: 02be1b30677f400788b35b03938e44e5 Oct 24 08:56:26.640086 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1868225476 Oct 24 08:56:26.640086 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User: tempest-AttachVolumeNegativeTest-1868225476-project Oct 24 08:56:26.640086 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Id: default Oct 24 08:56:26.640086 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Name: Default Oct 24 08:56:26.640086 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Id: 712e5cf4cc004918817ab1802b9c69d6 Oct 24 08:56:26.640086 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Name: tempest-AttachVolumeNegativeTest-1868225476-project Oct 24 08:56:26.640086 dv-cinder-master-3-smb devstack@n-api.service[125165]: method: > Oct 24 08:56:26.640086 dv-cinder-master-3-smb devstack@n-api.service[125165]: exception: Instance f6890641-4753-4fb7-86a4-fb5782b1b5b1 could not be found. Oct 24 08:56:26.640086 dv-cinder-master-3-smb devstack@n-api.service[125165]: action_args: {'id': 'f6890641-4753-4fb7-86a4-fb5782b1b5b1'} Oct 24 08:56:26.641035 dv-cinder-master-3-smb devstack@n-api.service[125165]: {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:56:26.641035 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:26.641035 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:56:26.641035 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:56:26.641035 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:56:26.641035 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:56:26.641035 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:56:26.641035 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:56:26.641035 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:56:26.641035 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:56:26.641035 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6890641-4753-4fb7-86a4-fb5782b1b5b1 could not be found. Oct 24 08:56:26.641035 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:56:26.641035 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:26.641035 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:56:26.641035 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:26.641035 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:26.641035 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:26.641035 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:56:26.641035 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:56:26.641035 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:56:26.642558 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:56:26.642558 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:56:26.642558 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:56:26.642558 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:56:26.642558 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:56:26.642558 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:56:26.642558 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:56:26.642558 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6890641-4753-4fb7-86a4-fb5782b1b5b1 could not be found. Oct 24 08:56:26.642558 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:56:26.642558 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:26.642558 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:56:26.642558 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:26.642558 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:26.642558 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:26.642558 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:56:26.642558 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:56:26.642558 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6890641-4753-4fb7-86a4-fb5782b1b5b1 could not be found. Oct 24 08:56:26.642558 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:56:26.644199 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-a8b5f8fe-afa5-4a87-b510-1a06a8bdbe5e tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] Returning 404 to user: Instance f6890641-4753-4fb7-86a4-fb5782b1b5b1 could not be found. {{(pid=125165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:56:26.644199 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-a8b5f8fe-afa5-4a87-b510-1a06a8bdbe5e tempest-AttachVolumeNegativeTest-1868225476 tempest-AttachVolumeNegativeTest-1868225476-project] 10.222.0.26 "GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1" status: 404 len: 111 microversion: 2.1 time: 0.032843 Oct 24 08:56:26.644199 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 440/887] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:26 2022] GET /compute/v2.1/servers/f6890641-4753-4fb7-86a4-fb5782b1b5b1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 08:56:41.222098 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-87437e53-7c81-4c8f-88a3-6c42eebd35fe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:41.224285 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-87437e53-7c81-4c8f-88a3-6c42eebd35fe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:41.226880 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:41.227686 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:41.234081 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-87437e53-7c81-4c8f-88a3-6c42eebd35fe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:41.234569 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-87437e53-7c81-4c8f-88a3-6c42eebd35fe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:41.235054 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-87437e53-7c81-4c8f-88a3-6c42eebd35fe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:41.235798 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-87437e53-7c81-4c8f-88a3-6c42eebd35fe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:41.236253 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-87437e53-7c81-4c8f-88a3-6c42eebd35fe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:41.236678 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-87437e53-7c81-4c8f-88a3-6c42eebd35fe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:41.270931 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-87437e53-7c81-4c8f-88a3-6c42eebd35fe tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052809 Oct 24 08:56:41.271708 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 448/888] 10.222.0.26 () {60 vars in 1343 bytes} [Mon Oct 24 08:56:41 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:41.335248 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-a5d78c21-5b64-4c4f-be5a-9d3dea7b01b0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:41.335746 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-a5d78c21-5b64-4c4f-be5a-9d3dea7b01b0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:41.338433 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell0:SELECT=4 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:41.339477 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:41.339947 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:41.346473 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a5d78c21-5b64-4c4f-be5a-9d3dea7b01b0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:41.346980 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a5d78c21-5b64-4c4f-be5a-9d3dea7b01b0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:41.347415 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a5d78c21-5b64-4c4f-be5a-9d3dea7b01b0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:41.348140 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a5d78c21-5b64-4c4f-be5a-9d3dea7b01b0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:41.348536 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a5d78c21-5b64-4c4f-be5a-9d3dea7b01b0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:41.348957 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a5d78c21-5b64-4c4f-be5a-9d3dea7b01b0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:41.377654 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-a5d78c21-5b64-4c4f-be5a-9d3dea7b01b0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Going to try to terminate instance {{(pid=125165) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:56:41.464728 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-a5d78c21-5b64-4c4f-be5a-9d3dea7b01b0 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "DELETE /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 204 len: 0 microversion: 2.20 time: 0.133034 Oct 24 08:56:41.465496 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 441/889] 10.222.0.26 () {60 vars in 1280 bytes} [Mon Oct 24 08:56:41 2022] DELETE /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 08:56:41.474274 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-32ae364d-0144-4b26-8d20-8ce3a535162b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:41.475223 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-32ae364d-0144-4b26-8d20-8ce3a535162b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:41.481884 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-32ae364d-0144-4b26-8d20-8ce3a535162b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:41.482373 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-32ae364d-0144-4b26-8d20-8ce3a535162b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:41.482833 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-32ae364d-0144-4b26-8d20-8ce3a535162b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:41.483723 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-32ae364d-0144-4b26-8d20-8ce3a535162b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:41.484185 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-32ae364d-0144-4b26-8d20-8ce3a535162b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:41.484609 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-32ae364d-0144-4b26-8d20-8ce3a535162b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:41.624127 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-32ae364d-0144-4b26-8d20-8ce3a535162b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:41.632132 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-32ae364d-0144-4b26-8d20-8ce3a535162b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:41.633536 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-32ae364d-0144-4b26-8d20-8ce3a535162b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:41.634696 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-32ae364d-0144-4b26-8d20-8ce3a535162b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1723 microversion: 2.20 time: 0.164655 Oct 24 08:56:41.635259 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 449/890] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:41 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:56:42.575694 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-257bd542-6ff6-4383-96a0-b1b6ab65158f tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-727642890", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-805533992", "security_groups": [{"name": "tempest-secgroup-smoke-448790393"}], "networks": [{"uuid": "cfcabac4-64ce-4888-ab74-beb4a60244d6"}], "block_device_mapping_v2": [{"uuid": "5716e73c-c0bb-47fb-ab57-e52fb9fd648d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:42.659638 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-a9cc6ff5-eff2-4f91-92bc-e92517f61b0d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:42.660964 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-a9cc6ff5-eff2-4f91-92bc-e92517f61b0d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:42.667506 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a9cc6ff5-eff2-4f91-92bc-e92517f61b0d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:42.668171 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a9cc6ff5-eff2-4f91-92bc-e92517f61b0d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:42.668925 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a9cc6ff5-eff2-4f91-92bc-e92517f61b0d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:42.670040 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a9cc6ff5-eff2-4f91-92bc-e92517f61b0d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:42.670647 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a9cc6ff5-eff2-4f91-92bc-e92517f61b0d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:42.671416 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a9cc6ff5-eff2-4f91-92bc-e92517f61b0d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:42.695597 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.network.neutron [None req-257bd542-6ff6-4383-96a0-b1b6ab65158f tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] validate_networks() for [('cfcabac4-64ce-4888-ab74-beb4a60244d6', None, None, None, None, None)] {{(pid=125165) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:56:42.900506 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-a9cc6ff5-eff2-4f91-92bc-e92517f61b0d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:42.909422 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-a9cc6ff5-eff2-4f91-92bc-e92517f61b0d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:42.911045 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-a9cc6ff5-eff2-4f91-92bc-e92517f61b0d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:42.912306 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-a9cc6ff5-eff2-4f91-92bc-e92517f61b0d tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1723 microversion: 2.20 time: 0.256822 Oct 24 08:56:42.912935 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 450/891] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:42 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 08:56:43.141758 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-257bd542-6ff6-4383-96a0-b1b6ab65158f tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Flavor limits 0:0:0 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:56:43.142305 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-257bd542-6ff6-4383-96a0-b1b6ab65158f tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Image limits 0:0:0 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:56:43.142808 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-257bd542-6ff6-4383-96a0-b1b6ab65158f tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Flavor pref 0:0:0 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:56:43.143362 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-257bd542-6ff6-4383-96a0-b1b6ab65158f tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Image pref 0:0:0 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:56:43.143927 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-257bd542-6ff6-4383-96a0-b1b6ab65158f tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:56:43.154814 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-257bd542-6ff6-4383-96a0-b1b6ab65158f tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:43.155295 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-257bd542-6ff6-4383-96a0-b1b6ab65158f tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:43.155745 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-257bd542-6ff6-4383-96a0-b1b6ab65158f tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:43.156457 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-257bd542-6ff6-4383-96a0-b1b6ab65158f tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:43.156902 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-257bd542-6ff6-4383-96a0-b1b6ab65158f tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:43.157316 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-257bd542-6ff6-4383-96a0-b1b6ab65158f tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:43.174066 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.quota [None req-257bd542-6ff6-4383-96a0-b1b6ab65158f tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Getting quotas for project 6d2806e58f714af7a7f739a59d3dece1. Resources: {'ram', 'cores', 'instances'} {{(pid=125165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:56:43.178049 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.quota [None req-257bd542-6ff6-4383-96a0-b1b6ab65158f tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Getting quotas for user a7c4228e92254a65ada3a0a777812103 and project 6d2806e58f714af7a7f739a59d3dece1. Resources: {'ram', 'cores', 'instances'} {{(pid=125165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:56:43.235998 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-257bd542-6ff6-4383-96a0-b1b6ab65158f tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Going to run 1 instances... {{(pid=125165) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:56:43.238399 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-257bd542-6ff6-4383-96a0-b1b6ab65158f tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5716e73c-c0bb-47fb-ab57-e52fb9fd648d',volume_size=None,volume_type=None)] {{(pid=125165) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:56:43.397407 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-257bd542-6ff6-4383-96a0-b1b6ab65158f tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.826100 Oct 24 08:56:43.398043 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 442/892] 10.222.0.26 () {60 vars in 1147 bytes} [Mon Oct 24 08:56:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:56:43.410132 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-4f80a373-7a80-4d97-bbb9-7be6ba821a87 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:43.410961 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-4f80a373-7a80-4d97-bbb9-7be6ba821a87 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:43.484433 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-4f80a373-7a80-4d97-bbb9-7be6ba821a87 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c4228e92254a65ada3a0a777812103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2806e58f714af7a7f739a59d3dece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:43.491805 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-4f80a373-7a80-4d97-bbb9-7be6ba821a87 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771" status: 200 len: 1087 microversion: 2.1 time: 0.086313 Oct 24 08:56:43.492507 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 451/893] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:43 2022] GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771 => generated 1087 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:56:43.938396 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-bfc6c66e-0113-44fb-ad94-8bd4c0429ec4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:43.939053 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-bfc6c66e-0113-44fb-ad94-8bd4c0429ec4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:43.949359 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bfc6c66e-0113-44fb-ad94-8bd4c0429ec4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:43.949852 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bfc6c66e-0113-44fb-ad94-8bd4c0429ec4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:43.950329 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bfc6c66e-0113-44fb-ad94-8bd4c0429ec4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:43.951330 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bfc6c66e-0113-44fb-ad94-8bd4c0429ec4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:43.952302 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bfc6c66e-0113-44fb-ad94-8bd4c0429ec4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:43.952999 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bfc6c66e-0113-44fb-ad94-8bd4c0429ec4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:44.028251 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-bfc6c66e-0113-44fb-ad94-8bd4c0429ec4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:44.047299 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-bfc6c66e-0113-44fb-ad94-8bd4c0429ec4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:44.049843 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-bfc6c66e-0113-44fb-ad94-8bd4c0429ec4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:44.051853 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-bfc6c66e-0113-44fb-ad94-8bd4c0429ec4 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1655 microversion: 2.20 time: 0.117986 Oct 24 08:56:44.063402 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 443/894] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:43 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1655 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:56:44.461528 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-c6ddfff2-72f8-4984-b463-7a5577c4a8cb req-105982dd-5ad5-48d0-93b5-1c2071d31a1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa2753cf-624f-4bf1-b85b-0fef0e35521c", "name": "network-vif-deleted", "tag": "8db8d394-e903-4fe4-92d4-9750c49eb4c4"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:44.474550 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-c6ddfff2-72f8-4984-b463-7a5577c4a8cb req-105982dd-5ad5-48d0-93b5-1c2071d31a1a service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:44.475225 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-c6ddfff2-72f8-4984-b463-7a5577c4a8cb req-105982dd-5ad5-48d0-93b5-1c2071d31a1a service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:44.475751 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-c6ddfff2-72f8-4984-b463-7a5577c4a8cb req-105982dd-5ad5-48d0-93b5-1c2071d31a1a service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:44.486710 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-c6ddfff2-72f8-4984-b463-7a5577c4a8cb req-105982dd-5ad5-48d0-93b5-1c2071d31a1a service nova] Creating event network-vif-deleted:8db8d394-e903-4fe4-92d4-9750c49eb4c4 for instance aa2753cf-624f-4bf1-b85b-0fef0e35521c on hv-cinder-maste Oct 24 08:56:44.491833 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-c6ddfff2-72f8-4984-b463-7a5577c4a8cb req-105982dd-5ad5-48d0-93b5-1c2071d31a1a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034503 Oct 24 08:56:44.493014 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 452/895] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:44.516130 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-a7024155-f36f-422c-9662-7f12dfb5a28f tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:44.516736 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-a7024155-f36f-422c-9662-7f12dfb5a28f tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:44.522591 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a7024155-f36f-422c-9662-7f12dfb5a28f tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:44.523302 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a7024155-f36f-422c-9662-7f12dfb5a28f tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:44.523892 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a7024155-f36f-422c-9662-7f12dfb5a28f tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:44.524733 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a7024155-f36f-422c-9662-7f12dfb5a28f tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:44.525389 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a7024155-f36f-422c-9662-7f12dfb5a28f tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:44.525981 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a7024155-f36f-422c-9662-7f12dfb5a28f tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:44.603420 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a7024155-f36f-422c-9662-7f12dfb5a28f tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c4228e92254a65ada3a0a777812103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2806e58f714af7a7f739a59d3dece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:44.611707 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-a7024155-f36f-422c-9662-7f12dfb5a28f tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771" status: 200 len: 1185 microversion: 2.1 time: 0.099501 Oct 24 08:56:44.612247 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 444/896] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:44 2022] GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771 => generated 1185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:56:45.079111 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-5152f1e0-574a-4814-af01-0962bd95f988 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:45.079864 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-5152f1e0-574a-4814-af01-0962bd95f988 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:45.087096 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5152f1e0-574a-4814-af01-0962bd95f988 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:45.087850 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5152f1e0-574a-4814-af01-0962bd95f988 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:45.088504 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5152f1e0-574a-4814-af01-0962bd95f988 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:45.089437 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5152f1e0-574a-4814-af01-0962bd95f988 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:45.090073 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5152f1e0-574a-4814-af01-0962bd95f988 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:45.090860 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5152f1e0-574a-4814-af01-0962bd95f988 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:45.131832 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5152f1e0-574a-4814-af01-0962bd95f988 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:45.132632 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5152f1e0-574a-4814-af01-0962bd95f988 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:45.133286 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5152f1e0-574a-4814-af01-0962bd95f988 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:45.133795 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.objects.instance [None req-5152f1e0-574a-4814-af01-0962bd95f988 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lazy-loading 'fault' on Instance uuid aa2753cf-624f-4bf1-b85b-0fef0e35521c {{(pid=125164) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:56:45.199974 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-5152f1e0-574a-4814-af01-0962bd95f988 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:45.210042 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-5152f1e0-574a-4814-af01-0962bd95f988 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:45.211941 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-5152f1e0-574a-4814-af01-0962bd95f988 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43af1b9b66804624aff6eef2f435d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca750f880a44988f7324b2f8da3e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:45.213414 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-5152f1e0-574a-4814-af01-0962bd95f988 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 200 len: 1372 microversion: 2.20 time: 0.139179 Oct 24 08:56:45.226780 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 453/897] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:45 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 1372 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 08:56:45.637114 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-91206a01-3bf3-49dc-9b02-9465290e5259 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:45.637734 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-91206a01-3bf3-49dc-9b02-9465290e5259 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:45.653893 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-91206a01-3bf3-49dc-9b02-9465290e5259 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:45.658941 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-91206a01-3bf3-49dc-9b02-9465290e5259 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:45.659934 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-91206a01-3bf3-49dc-9b02-9465290e5259 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:45.660950 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-91206a01-3bf3-49dc-9b02-9465290e5259 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:45.661956 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-91206a01-3bf3-49dc-9b02-9465290e5259 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:45.679599 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-91206a01-3bf3-49dc-9b02-9465290e5259 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:45.928124 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-91206a01-3bf3-49dc-9b02-9465290e5259 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c4228e92254a65ada3a0a777812103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2806e58f714af7a7f739a59d3dece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:45.936561 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-91206a01-3bf3-49dc-9b02-9465290e5259 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771" status: 200 len: 1258 microversion: 2.1 time: 0.305557 Oct 24 08:56:45.952444 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 445/898] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:45 2022] GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771 => generated 1258 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:46.240058 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-70295f55-a50f-486e-be01-aa34a31053b3 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:46.240666 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-70295f55-a50f-486e-be01-aa34a31053b3 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:46.246997 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-70295f55-a50f-486e-be01-aa34a31053b3 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:46.247521 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-70295f55-a50f-486e-be01-aa34a31053b3 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:46.248294 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-70295f55-a50f-486e-be01-aa34a31053b3 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:46.248993 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-70295f55-a50f-486e-be01-aa34a31053b3 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:46.249445 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-70295f55-a50f-486e-be01-aa34a31053b3 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:46.249862 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-70295f55-a50f-486e-be01-aa34a31053b3 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:46.264548 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.wsgi [None req-70295f55-a50f-486e-be01-aa34a31053b3 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] HTTP exception thrown: Instance aa2753cf-624f-4bf1-b85b-0fef0e35521c could not be found. Oct 24 08:56:46.266406 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-70295f55-a50f-486e-be01-aa34a31053b3 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Request method failure captured: Oct 24 08:56:46.266406 dv-cinder-master-3-smb devstack@n-api.service[125164]: request: GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c HTTP/1.1 Oct 24 08:56:46.266406 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept: application/json Oct 24 08:56:46.266406 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept-Encoding: identity Oct 24 08:56:46.266406 dv-cinder-master-3-smb devstack@n-api.service[125164]: Connection: close Oct 24 08:56:46.266406 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Length: 0 Oct 24 08:56:46.266406 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Type: application/json Oct 24 08:56:46.266406 dv-cinder-master-3-smb devstack@n-api.service[125164]: Host: 10.222.0.26 Oct 24 08:56:46.266406 dv-cinder-master-3-smb devstack@n-api.service[125164]: Openstack-System-Scope: None Oct 24 08:56:46.266406 dv-cinder-master-3-smb devstack@n-api.service[125164]: User-Agent: python-urllib3/1.26.12 Oct 24 08:56:46.266406 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Auth-Token: gAAAAABjVlE9aCQ2ngbo3b7nJ6ZGeJTAG-wCQeUxjg1cUuyWWmpWzwmJrK40UyCA6n1ENMQcQ7n_9uAhNCH5AwZNFjQ3GJaDLdyvaFaxypjoVbX2AU6DS4_0a8UCylR05rHmIJT9J7p0dUD8pQbSHMSONZCPcs4qIDXr6BS2AIkdwIBH4WGLMqQ Oct 24 08:56:46.266406 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Id: None Oct 24 08:56:46.266406 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Name: None Oct 24 08:56:46.266406 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Identity-Status: Confirmed Oct 24 08:56:46.266406 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Is-Admin-Project: True Oct 24 08:56:46.266406 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Openstack-Nova-Api-Version: 2.20 Oct 24 08:56:46.266406 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Id: default Oct 24 08:56:46.266406 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Name: Default Oct 24 08:56:46.266406 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Id: 5bca750f880a44988f7324b2f8da3e7b Oct 24 08:56:46.266406 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2140536292 Oct 24 08:56:46.266406 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Role: reader,member Oct 24 08:56:46.266406 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Roles: reader,member Oct 24 08:56:46.268109 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5bca750f880a44988f7324b2f8da3e7b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5bca750f880a44988f7324b2f8da3e7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5bca750f880a44988f7324b2f8da3e7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5bca750f880a44988f7324b2f8da3e7b"}]}] Oct 24 08:56:46.268109 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2140536292 Oct 24 08:56:46.268109 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Id: 5bca750f880a44988f7324b2f8da3e7b Oct 24 08:56:46.268109 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2140536292 Oct 24 08:56:46.268109 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User: tempest-AttachVolumeShelveTestJSON-2140536292-project Oct 24 08:56:46.268109 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Id: default Oct 24 08:56:46.268109 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Name: Default Oct 24 08:56:46.268109 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Id: 43af1b9b66804624aff6eef2f435d581 Oct 24 08:56:46.268109 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2140536292-project Oct 24 08:56:46.268109 dv-cinder-master-3-smb devstack@n-api.service[125164]: method: > Oct 24 08:56:46.268109 dv-cinder-master-3-smb devstack@n-api.service[125164]: exception: Instance aa2753cf-624f-4bf1-b85b-0fef0e35521c could not be found. Oct 24 08:56:46.268109 dv-cinder-master-3-smb devstack@n-api.service[125164]: action_args: {'id': 'aa2753cf-624f-4bf1-b85b-0fef0e35521c'} Oct 24 08:56:46.268911 dv-cinder-master-3-smb devstack@n-api.service[125164]: {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:56:46.268911 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:46.268911 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:56:46.268911 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:56:46.268911 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:56:46.268911 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:56:46.268911 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:56:46.268911 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:56:46.268911 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:56:46.268911 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:56:46.268911 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa2753cf-624f-4bf1-b85b-0fef0e35521c could not be found. Oct 24 08:56:46.268911 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:56:46.268911 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:46.268911 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:56:46.268911 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:46.268911 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:46.268911 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:46.268911 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:56:46.268911 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:56:46.268911 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:56:46.270272 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:56:46.270272 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:56:46.270272 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:56:46.270272 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:56:46.270272 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:56:46.270272 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:56:46.270272 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:56:46.270272 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa2753cf-624f-4bf1-b85b-0fef0e35521c could not be found. Oct 24 08:56:46.270272 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:56:46.270272 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:46.270272 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:56:46.270272 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:46.270272 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:46.270272 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:46.270272 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:56:46.270272 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:56:46.270272 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa2753cf-624f-4bf1-b85b-0fef0e35521c could not be found. Oct 24 08:56:46.270272 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:56:46.272317 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-70295f55-a50f-486e-be01-aa34a31053b3 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Returning 404 to user: Instance aa2753cf-624f-4bf1-b85b-0fef0e35521c could not be found. {{(pid=125164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:56:46.273324 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-70295f55-a50f-486e-be01-aa34a31053b3 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 404 len: 111 microversion: 2.20 time: 0.037188 Oct 24 08:56:46.274204 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 454/899] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:46 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 08:56:46.284897 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-8bd006ce-d2fd-4dc4-84f0-75cbf45007c9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '.version_select at 0x7f7ef1462160>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:46.317059 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-8bd006ce-d2fd-4dc4-84f0-75cbf45007c9 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1548869952" status: 204 len: 0 microversion: 2.20 time: 0.038161 Oct 24 08:56:46.317664 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 446/900] 10.222.0.26 () {60 vars in 1262 bytes} [Mon Oct 24 08:56:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1548869952 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 24 08:56:46.529711 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-048893ff-b104-4a06-a53d-7ec947863227 req-49a1ef7c-51c4-4561-bc6a-fc0062369b68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6a3aec5-42e2-40ea-a383-0e2bf1a52771", "tag": "d1cd745a-6478-4f59-ad2c-346b7fe41e9f"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:46.546790 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-048893ff-b104-4a06-a53d-7ec947863227 req-49a1ef7c-51c4-4561-bc6a-fc0062369b68 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:46.547275 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-048893ff-b104-4a06-a53d-7ec947863227 req-49a1ef7c-51c4-4561-bc6a-fc0062369b68 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:46.547698 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-048893ff-b104-4a06-a53d-7ec947863227 req-49a1ef7c-51c4-4561-bc6a-fc0062369b68 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:46.559509 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-048893ff-b104-4a06-a53d-7ec947863227 req-49a1ef7c-51c4-4561-bc6a-fc0062369b68 service nova] Creating event network-changed:d1cd745a-6478-4f59-ad2c-346b7fe41e9f for instance b6a3aec5-42e2-40ea-a383-0e2bf1a52771 on hv-cinder-maste Oct 24 08:56:46.565487 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-048893ff-b104-4a06-a53d-7ec947863227 req-49a1ef7c-51c4-4561-bc6a-fc0062369b68 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040104 Oct 24 08:56:46.566771 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 455/901] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:46.965125 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-369bc33a-af4e-4c54-adf6-be91e814c879 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:46.965706 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-369bc33a-af4e-4c54-adf6-be91e814c879 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:46.972374 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-369bc33a-af4e-4c54-adf6-be91e814c879 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:46.973062 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-369bc33a-af4e-4c54-adf6-be91e814c879 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:46.973493 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-369bc33a-af4e-4c54-adf6-be91e814c879 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:46.974184 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-369bc33a-af4e-4c54-adf6-be91e814c879 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:46.974827 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-369bc33a-af4e-4c54-adf6-be91e814c879 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:46.975398 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-369bc33a-af4e-4c54-adf6-be91e814c879 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:47.158250 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-369bc33a-af4e-4c54-adf6-be91e814c879 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c4228e92254a65ada3a0a777812103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2806e58f714af7a7f739a59d3dece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:47.171765 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-369bc33a-af4e-4c54-adf6-be91e814c879 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771" status: 200 len: 1258 microversion: 2.1 time: 0.209498 Oct 24 08:56:47.171765 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 447/902] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:46 2022] GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771 => generated 1258 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:48.194417 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-22fabfc7-7ad5-4318-97f1-dc61f3e19817 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:48.195192 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-22fabfc7-7ad5-4318-97f1-dc61f3e19817 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:48.203011 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-22fabfc7-7ad5-4318-97f1-dc61f3e19817 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:48.203011 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-22fabfc7-7ad5-4318-97f1-dc61f3e19817 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:48.203011 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-22fabfc7-7ad5-4318-97f1-dc61f3e19817 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:48.203811 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-22fabfc7-7ad5-4318-97f1-dc61f3e19817 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:48.204137 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-22fabfc7-7ad5-4318-97f1-dc61f3e19817 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:48.204587 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-22fabfc7-7ad5-4318-97f1-dc61f3e19817 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:48.249691 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-7d63fefd-ed18-4432-9c08-bc6d16670c96 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:48.250334 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-7d63fefd-ed18-4432-9c08-bc6d16670c96 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:48.257103 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7d63fefd-ed18-4432-9c08-bc6d16670c96 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:48.257721 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7d63fefd-ed18-4432-9c08-bc6d16670c96 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:48.258279 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7d63fefd-ed18-4432-9c08-bc6d16670c96 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:48.259113 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7d63fefd-ed18-4432-9c08-bc6d16670c96 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:48.259667 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7d63fefd-ed18-4432-9c08-bc6d16670c96 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:48.260164 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7d63fefd-ed18-4432-9c08-bc6d16670c96 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:48.273902 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.wsgi [None req-7d63fefd-ed18-4432-9c08-bc6d16670c96 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] HTTP exception thrown: Instance aa2753cf-624f-4bf1-b85b-0fef0e35521c could not be found. Oct 24 08:56:48.275688 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-7d63fefd-ed18-4432-9c08-bc6d16670c96 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Request method failure captured: Oct 24 08:56:48.275688 dv-cinder-master-3-smb devstack@n-api.service[125165]: request: DELETE /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c HTTP/1.1 Oct 24 08:56:48.275688 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept: application/json Oct 24 08:56:48.275688 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept-Encoding: identity Oct 24 08:56:48.275688 dv-cinder-master-3-smb devstack@n-api.service[125165]: Connection: close Oct 24 08:56:48.275688 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Length: 0 Oct 24 08:56:48.275688 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Type: application/json Oct 24 08:56:48.275688 dv-cinder-master-3-smb devstack@n-api.service[125165]: Host: 10.222.0.26 Oct 24 08:56:48.275688 dv-cinder-master-3-smb devstack@n-api.service[125165]: Openstack-System-Scope: None Oct 24 08:56:48.275688 dv-cinder-master-3-smb devstack@n-api.service[125165]: User-Agent: python-urllib3/1.26.12 Oct 24 08:56:48.275688 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Auth-Token: gAAAAABjVlE9aCQ2ngbo3b7nJ6ZGeJTAG-wCQeUxjg1cUuyWWmpWzwmJrK40UyCA6n1ENMQcQ7n_9uAhNCH5AwZNFjQ3GJaDLdyvaFaxypjoVbX2AU6DS4_0a8UCylR05rHmIJT9J7p0dUD8pQbSHMSONZCPcs4qIDXr6BS2AIkdwIBH4WGLMqQ Oct 24 08:56:48.275688 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Id: None Oct 24 08:56:48.275688 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Name: None Oct 24 08:56:48.275688 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Identity-Status: Confirmed Oct 24 08:56:48.275688 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Is-Admin-Project: True Oct 24 08:56:48.275688 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Openstack-Nova-Api-Version: 2.20 Oct 24 08:56:48.275688 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Id: default Oct 24 08:56:48.275688 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Name: Default Oct 24 08:56:48.275688 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Id: 5bca750f880a44988f7324b2f8da3e7b Oct 24 08:56:48.275688 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2140536292 Oct 24 08:56:48.275688 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Role: reader,member Oct 24 08:56:48.275688 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Roles: reader,member Oct 24 08:56:48.277558 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5bca750f880a44988f7324b2f8da3e7b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5bca750f880a44988f7324b2f8da3e7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5bca750f880a44988f7324b2f8da3e7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5bca750f880a44988f7324b2f8da3e7b"}]}] Oct 24 08:56:48.277558 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2140536292 Oct 24 08:56:48.277558 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Id: 5bca750f880a44988f7324b2f8da3e7b Oct 24 08:56:48.277558 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2140536292 Oct 24 08:56:48.277558 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User: tempest-AttachVolumeShelveTestJSON-2140536292-project Oct 24 08:56:48.277558 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Id: default Oct 24 08:56:48.277558 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Name: Default Oct 24 08:56:48.277558 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Id: 43af1b9b66804624aff6eef2f435d581 Oct 24 08:56:48.277558 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2140536292-project Oct 24 08:56:48.277558 dv-cinder-master-3-smb devstack@n-api.service[125165]: method: > Oct 24 08:56:48.277558 dv-cinder-master-3-smb devstack@n-api.service[125165]: exception: Instance aa2753cf-624f-4bf1-b85b-0fef0e35521c could not be found. Oct 24 08:56:48.277558 dv-cinder-master-3-smb devstack@n-api.service[125165]: action_args: {'id': 'aa2753cf-624f-4bf1-b85b-0fef0e35521c'} Oct 24 08:56:48.278414 dv-cinder-master-3-smb devstack@n-api.service[125165]: {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:56:48.278414 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:48.278414 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:56:48.278414 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:56:48.278414 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:56:48.278414 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:56:48.278414 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:56:48.278414 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:56:48.278414 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:56:48.278414 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:56:48.278414 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa2753cf-624f-4bf1-b85b-0fef0e35521c could not be found. Oct 24 08:56:48.278414 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:56:48.278414 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:48.278414 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:56:48.278414 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:48.278414 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:48.278414 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:48.278414 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:56:48.278414 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:56:48.278414 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:56:48.280076 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:56:48.280076 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 08:56:48.280076 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 08:56:48.280076 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 08:56:48.280076 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 08:56:48.280076 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:56:48.280076 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:56:48.280076 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:56:48.280076 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:56:48.280076 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa2753cf-624f-4bf1-b85b-0fef0e35521c could not be found. Oct 24 08:56:48.280076 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:56:48.280076 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:48.280076 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:56:48.280076 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:48.280076 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:48.280076 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:48.280076 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:56:48.280076 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:56:48.280076 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa2753cf-624f-4bf1-b85b-0fef0e35521c could not be found. Oct 24 08:56:48.280076 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:56:48.281639 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-7d63fefd-ed18-4432-9c08-bc6d16670c96 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Returning 404 to user: Instance aa2753cf-624f-4bf1-b85b-0fef0e35521c could not be found. {{(pid=125165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:56:48.281639 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-7d63fefd-ed18-4432-9c08-bc6d16670c96 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "DELETE /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 404 len: 111 microversion: 2.20 time: 0.031426 Oct 24 08:56:48.281639 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 448/903] 10.222.0.26 () {60 vars in 1280 bytes} [Mon Oct 24 08:56:48 2022] DELETE /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 08:56:48.286042 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-be3de8df-d815-4483-9f32-9dba1da8e08b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:48.286593 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-be3de8df-d815-4483-9f32-9dba1da8e08b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: aa2753cf-624f-4bf1-b85b-0fef0e35521c] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:48.292978 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-be3de8df-d815-4483-9f32-9dba1da8e08b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:48.293463 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-be3de8df-d815-4483-9f32-9dba1da8e08b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:48.293893 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-be3de8df-d815-4483-9f32-9dba1da8e08b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:48.294804 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-be3de8df-d815-4483-9f32-9dba1da8e08b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:48.295044 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-be3de8df-d815-4483-9f32-9dba1da8e08b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:48.295464 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-be3de8df-d815-4483-9f32-9dba1da8e08b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:48.312340 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.wsgi [None req-be3de8df-d815-4483-9f32-9dba1da8e08b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] HTTP exception thrown: Instance aa2753cf-624f-4bf1-b85b-0fef0e35521c could not be found. Oct 24 08:56:48.313787 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-be3de8df-d815-4483-9f32-9dba1da8e08b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Request method failure captured: Oct 24 08:56:48.313787 dv-cinder-master-3-smb devstack@n-api.service[125165]: request: GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c HTTP/1.1 Oct 24 08:56:48.313787 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept: application/json Oct 24 08:56:48.313787 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept-Encoding: identity Oct 24 08:56:48.313787 dv-cinder-master-3-smb devstack@n-api.service[125165]: Connection: close Oct 24 08:56:48.313787 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Length: 0 Oct 24 08:56:48.313787 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Type: application/json Oct 24 08:56:48.313787 dv-cinder-master-3-smb devstack@n-api.service[125165]: Host: 10.222.0.26 Oct 24 08:56:48.313787 dv-cinder-master-3-smb devstack@n-api.service[125165]: Openstack-System-Scope: None Oct 24 08:56:48.313787 dv-cinder-master-3-smb devstack@n-api.service[125165]: User-Agent: python-urllib3/1.26.12 Oct 24 08:56:48.313787 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Auth-Token: gAAAAABjVlE9aCQ2ngbo3b7nJ6ZGeJTAG-wCQeUxjg1cUuyWWmpWzwmJrK40UyCA6n1ENMQcQ7n_9uAhNCH5AwZNFjQ3GJaDLdyvaFaxypjoVbX2AU6DS4_0a8UCylR05rHmIJT9J7p0dUD8pQbSHMSONZCPcs4qIDXr6BS2AIkdwIBH4WGLMqQ Oct 24 08:56:48.313787 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Id: None Oct 24 08:56:48.313787 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Name: None Oct 24 08:56:48.313787 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Identity-Status: Confirmed Oct 24 08:56:48.313787 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Is-Admin-Project: True Oct 24 08:56:48.313787 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Openstack-Nova-Api-Version: 2.20 Oct 24 08:56:48.313787 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Id: default Oct 24 08:56:48.313787 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Name: Default Oct 24 08:56:48.313787 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Id: 5bca750f880a44988f7324b2f8da3e7b Oct 24 08:56:48.313787 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2140536292 Oct 24 08:56:48.313787 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Role: reader,member Oct 24 08:56:48.313787 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Roles: reader,member Oct 24 08:56:48.315284 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5bca750f880a44988f7324b2f8da3e7b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5bca750f880a44988f7324b2f8da3e7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5bca750f880a44988f7324b2f8da3e7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5bca750f880a44988f7324b2f8da3e7b"}]}] Oct 24 08:56:48.315284 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2140536292 Oct 24 08:56:48.315284 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Id: 5bca750f880a44988f7324b2f8da3e7b Oct 24 08:56:48.315284 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2140536292 Oct 24 08:56:48.315284 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User: tempest-AttachVolumeShelveTestJSON-2140536292-project Oct 24 08:56:48.315284 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Id: default Oct 24 08:56:48.315284 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Name: Default Oct 24 08:56:48.315284 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Id: 43af1b9b66804624aff6eef2f435d581 Oct 24 08:56:48.315284 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2140536292-project Oct 24 08:56:48.315284 dv-cinder-master-3-smb devstack@n-api.service[125165]: method: > Oct 24 08:56:48.315284 dv-cinder-master-3-smb devstack@n-api.service[125165]: exception: Instance aa2753cf-624f-4bf1-b85b-0fef0e35521c could not be found. Oct 24 08:56:48.315284 dv-cinder-master-3-smb devstack@n-api.service[125165]: action_args: {'id': 'aa2753cf-624f-4bf1-b85b-0fef0e35521c'} Oct 24 08:56:48.316066 dv-cinder-master-3-smb devstack@n-api.service[125165]: {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:56:48.316066 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:48.316066 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:56:48.316066 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:56:48.316066 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:56:48.316066 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:56:48.316066 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:56:48.316066 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:56:48.316066 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:56:48.316066 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:56:48.316066 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa2753cf-624f-4bf1-b85b-0fef0e35521c could not be found. Oct 24 08:56:48.316066 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:56:48.316066 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:48.316066 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:56:48.316066 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:48.316066 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:48.316066 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:48.316066 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:56:48.316066 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:56:48.316066 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:56:48.317288 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:56:48.317288 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:56:48.317288 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:56:48.317288 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:56:48.317288 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:56:48.317288 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:56:48.317288 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:56:48.317288 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa2753cf-624f-4bf1-b85b-0fef0e35521c could not be found. Oct 24 08:56:48.317288 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:56:48.317288 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:48.317288 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:56:48.317288 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:48.317288 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:48.317288 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:48.317288 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:56:48.317288 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:56:48.317288 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa2753cf-624f-4bf1-b85b-0fef0e35521c could not be found. Oct 24 08:56:48.317288 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:56:48.318398 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-be3de8df-d815-4483-9f32-9dba1da8e08b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Returning 404 to user: Instance aa2753cf-624f-4bf1-b85b-0fef0e35521c could not be found. {{(pid=125165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:56:48.318398 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-be3de8df-d815-4483-9f32-9dba1da8e08b tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c" status: 404 len: 111 microversion: 2.20 time: 0.032980 Oct 24 08:56:48.318398 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 449/904] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:48 2022] GET /compute/v2.1/servers/aa2753cf-624f-4bf1-b85b-0fef0e35521c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 24 08:56:48.361457 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-22fabfc7-7ad5-4318-97f1-dc61f3e19817 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c4228e92254a65ada3a0a777812103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2806e58f714af7a7f739a59d3dece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:48.369550 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-22fabfc7-7ad5-4318-97f1-dc61f3e19817 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771" status: 200 len: 1258 microversion: 2.1 time: 0.179587 Oct 24 08:56:48.370203 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 456/905] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:48 2022] GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771 => generated 1258 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:49.393500 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-6eb56b17-e493-4e95-972b-58a69a79e912 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:49.394074 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-6eb56b17-e493-4e95-972b-58a69a79e912 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:49.401635 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6eb56b17-e493-4e95-972b-58a69a79e912 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:49.402324 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6eb56b17-e493-4e95-972b-58a69a79e912 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:49.403010 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6eb56b17-e493-4e95-972b-58a69a79e912 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:49.403701 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6eb56b17-e493-4e95-972b-58a69a79e912 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:49.404340 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6eb56b17-e493-4e95-972b-58a69a79e912 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:49.404771 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-6eb56b17-e493-4e95-972b-58a69a79e912 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:49.475370 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-b5c64163-478d-406e-a1c6-bdc5c7367109 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:49.475906 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-b5c64163-478d-406e-a1c6-bdc5c7367109 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:49.482634 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b5c64163-478d-406e-a1c6-bdc5c7367109 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:49.483148 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b5c64163-478d-406e-a1c6-bdc5c7367109 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:49.483575 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b5c64163-478d-406e-a1c6-bdc5c7367109 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:49.484292 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b5c64163-478d-406e-a1c6-bdc5c7367109 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:49.484740 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b5c64163-478d-406e-a1c6-bdc5c7367109 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:49.485170 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-b5c64163-478d-406e-a1c6-bdc5c7367109 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:49.499332 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.wsgi [None req-b5c64163-478d-406e-a1c6-bdc5c7367109 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] HTTP exception thrown: Instance cf8e51c6-99cf-49c6-b25b-89c3c7045e4e could not be found. Oct 24 08:56:49.501771 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-b5c64163-478d-406e-a1c6-bdc5c7367109 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Request method failure captured: Oct 24 08:56:49.501771 dv-cinder-master-3-smb devstack@n-api.service[125164]: request: DELETE /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e HTTP/1.1 Oct 24 08:56:49.501771 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept: application/json Oct 24 08:56:49.501771 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept-Encoding: identity Oct 24 08:56:49.501771 dv-cinder-master-3-smb devstack@n-api.service[125164]: Connection: close Oct 24 08:56:49.501771 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Length: 0 Oct 24 08:56:49.501771 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Type: application/json Oct 24 08:56:49.501771 dv-cinder-master-3-smb devstack@n-api.service[125164]: Host: 10.222.0.26 Oct 24 08:56:49.501771 dv-cinder-master-3-smb devstack@n-api.service[125164]: Openstack-System-Scope: None Oct 24 08:56:49.501771 dv-cinder-master-3-smb devstack@n-api.service[125164]: User-Agent: python-urllib3/1.26.12 Oct 24 08:56:49.501771 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Auth-Token: gAAAAABjVlE9aCQ2ngbo3b7nJ6ZGeJTAG-wCQeUxjg1cUuyWWmpWzwmJrK40UyCA6n1ENMQcQ7n_9uAhNCH5AwZNFjQ3GJaDLdyvaFaxypjoVbX2AU6DS4_0a8UCylR05rHmIJT9J7p0dUD8pQbSHMSONZCPcs4qIDXr6BS2AIkdwIBH4WGLMqQ Oct 24 08:56:49.501771 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Id: None Oct 24 08:56:49.501771 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Name: None Oct 24 08:56:49.501771 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Identity-Status: Confirmed Oct 24 08:56:49.501771 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Is-Admin-Project: True Oct 24 08:56:49.501771 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Openstack-Nova-Api-Version: 2.20 Oct 24 08:56:49.501771 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Id: default Oct 24 08:56:49.501771 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Name: Default Oct 24 08:56:49.501771 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Id: 5bca750f880a44988f7324b2f8da3e7b Oct 24 08:56:49.501771 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2140536292 Oct 24 08:56:49.501771 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Role: reader,member Oct 24 08:56:49.501771 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Roles: reader,member Oct 24 08:56:49.503770 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5bca750f880a44988f7324b2f8da3e7b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5bca750f880a44988f7324b2f8da3e7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5bca750f880a44988f7324b2f8da3e7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5bca750f880a44988f7324b2f8da3e7b"}]}] Oct 24 08:56:49.503770 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2140536292 Oct 24 08:56:49.503770 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Id: 5bca750f880a44988f7324b2f8da3e7b Oct 24 08:56:49.503770 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2140536292 Oct 24 08:56:49.503770 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User: tempest-AttachVolumeShelveTestJSON-2140536292-project Oct 24 08:56:49.503770 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Id: default Oct 24 08:56:49.503770 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Name: Default Oct 24 08:56:49.503770 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Id: 43af1b9b66804624aff6eef2f435d581 Oct 24 08:56:49.503770 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2140536292-project Oct 24 08:56:49.503770 dv-cinder-master-3-smb devstack@n-api.service[125164]: method: > Oct 24 08:56:49.503770 dv-cinder-master-3-smb devstack@n-api.service[125164]: exception: Instance cf8e51c6-99cf-49c6-b25b-89c3c7045e4e could not be found. Oct 24 08:56:49.503770 dv-cinder-master-3-smb devstack@n-api.service[125164]: action_args: {'id': 'cf8e51c6-99cf-49c6-b25b-89c3c7045e4e'} Oct 24 08:56:49.504654 dv-cinder-master-3-smb devstack@n-api.service[125164]: {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:56:49.504654 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:49.504654 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:56:49.504654 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:56:49.504654 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:56:49.504654 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:56:49.504654 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:56:49.504654 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:56:49.504654 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:56:49.504654 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:56:49.504654 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf8e51c6-99cf-49c6-b25b-89c3c7045e4e could not be found. Oct 24 08:56:49.504654 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:56:49.504654 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:49.504654 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:56:49.504654 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:49.504654 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:49.504654 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:49.504654 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:56:49.504654 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:56:49.504654 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:56:49.505936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:56:49.505936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 08:56:49.505936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 08:56:49.505936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 08:56:49.505936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 08:56:49.505936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:56:49.505936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:56:49.505936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:56:49.505936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:56:49.505936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf8e51c6-99cf-49c6-b25b-89c3c7045e4e could not be found. Oct 24 08:56:49.505936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:56:49.505936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:49.505936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:56:49.505936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:49.505936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:49.505936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:49.505936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:56:49.505936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:56:49.505936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf8e51c6-99cf-49c6-b25b-89c3c7045e4e could not be found. Oct 24 08:56:49.505936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:56:49.507239 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-b5c64163-478d-406e-a1c6-bdc5c7367109 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Returning 404 to user: Instance cf8e51c6-99cf-49c6-b25b-89c3c7045e4e could not be found. {{(pid=125164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:56:49.507239 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-b5c64163-478d-406e-a1c6-bdc5c7367109 tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 404 len: 111 microversion: 2.20 time: 0.032177 Oct 24 08:56:49.507239 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 457/906] 10.222.0.26 () {60 vars in 1280 bytes} [Mon Oct 24 08:56:49 2022] DELETE /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 08:56:49.512119 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-970feb28-8aee-4c6b-8a64-66d36e70ee0f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:49.512896 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-970feb28-8aee-4c6b-8a64-66d36e70ee0f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] [instance: cf8e51c6-99cf-49c6-b25b-89c3c7045e4e] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:49.519136 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-970feb28-8aee-4c6b-8a64-66d36e70ee0f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:49.519619 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-970feb28-8aee-4c6b-8a64-66d36e70ee0f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:49.520049 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-970feb28-8aee-4c6b-8a64-66d36e70ee0f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:49.520736 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-970feb28-8aee-4c6b-8a64-66d36e70ee0f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:49.521191 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-970feb28-8aee-4c6b-8a64-66d36e70ee0f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:49.521605 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-970feb28-8aee-4c6b-8a64-66d36e70ee0f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:49.535974 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.wsgi [None req-970feb28-8aee-4c6b-8a64-66d36e70ee0f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] HTTP exception thrown: Instance cf8e51c6-99cf-49c6-b25b-89c3c7045e4e could not be found. Oct 24 08:56:49.537688 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-970feb28-8aee-4c6b-8a64-66d36e70ee0f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Request method failure captured: Oct 24 08:56:49.537688 dv-cinder-master-3-smb devstack@n-api.service[125164]: request: GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e HTTP/1.1 Oct 24 08:56:49.537688 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept: application/json Oct 24 08:56:49.537688 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept-Encoding: identity Oct 24 08:56:49.537688 dv-cinder-master-3-smb devstack@n-api.service[125164]: Connection: close Oct 24 08:56:49.537688 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Length: 0 Oct 24 08:56:49.537688 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Type: application/json Oct 24 08:56:49.537688 dv-cinder-master-3-smb devstack@n-api.service[125164]: Host: 10.222.0.26 Oct 24 08:56:49.537688 dv-cinder-master-3-smb devstack@n-api.service[125164]: Openstack-System-Scope: None Oct 24 08:56:49.537688 dv-cinder-master-3-smb devstack@n-api.service[125164]: User-Agent: python-urllib3/1.26.12 Oct 24 08:56:49.537688 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Auth-Token: gAAAAABjVlE9aCQ2ngbo3b7nJ6ZGeJTAG-wCQeUxjg1cUuyWWmpWzwmJrK40UyCA6n1ENMQcQ7n_9uAhNCH5AwZNFjQ3GJaDLdyvaFaxypjoVbX2AU6DS4_0a8UCylR05rHmIJT9J7p0dUD8pQbSHMSONZCPcs4qIDXr6BS2AIkdwIBH4WGLMqQ Oct 24 08:56:49.537688 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Id: None Oct 24 08:56:49.537688 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Name: None Oct 24 08:56:49.537688 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Identity-Status: Confirmed Oct 24 08:56:49.537688 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Is-Admin-Project: True Oct 24 08:56:49.537688 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Openstack-Nova-Api-Version: 2.20 Oct 24 08:56:49.537688 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Id: default Oct 24 08:56:49.537688 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Name: Default Oct 24 08:56:49.537688 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Id: 5bca750f880a44988f7324b2f8da3e7b Oct 24 08:56:49.537688 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2140536292 Oct 24 08:56:49.537688 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Role: reader,member Oct 24 08:56:49.537688 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Roles: reader,member Oct 24 08:56:49.539199 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5bca750f880a44988f7324b2f8da3e7b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5bca750f880a44988f7324b2f8da3e7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5bca750f880a44988f7324b2f8da3e7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5bca750f880a44988f7324b2f8da3e7b"}]}] Oct 24 08:56:49.539199 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2140536292 Oct 24 08:56:49.539199 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Id: 5bca750f880a44988f7324b2f8da3e7b Oct 24 08:56:49.539199 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2140536292 Oct 24 08:56:49.539199 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User: tempest-AttachVolumeShelveTestJSON-2140536292-project Oct 24 08:56:49.539199 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Id: default Oct 24 08:56:49.539199 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Name: Default Oct 24 08:56:49.539199 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Id: 43af1b9b66804624aff6eef2f435d581 Oct 24 08:56:49.539199 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2140536292-project Oct 24 08:56:49.539199 dv-cinder-master-3-smb devstack@n-api.service[125164]: method: > Oct 24 08:56:49.539199 dv-cinder-master-3-smb devstack@n-api.service[125164]: exception: Instance cf8e51c6-99cf-49c6-b25b-89c3c7045e4e could not be found. Oct 24 08:56:49.539199 dv-cinder-master-3-smb devstack@n-api.service[125164]: action_args: {'id': 'cf8e51c6-99cf-49c6-b25b-89c3c7045e4e'} Oct 24 08:56:49.540121 dv-cinder-master-3-smb devstack@n-api.service[125164]: {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:56:49.540121 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:49.540121 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:56:49.540121 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:56:49.540121 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:56:49.540121 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:56:49.540121 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:56:49.540121 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:56:49.540121 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:56:49.540121 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:56:49.540121 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf8e51c6-99cf-49c6-b25b-89c3c7045e4e could not be found. Oct 24 08:56:49.540121 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:56:49.540121 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:49.540121 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:56:49.540121 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:49.540121 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:49.540121 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:49.540121 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:56:49.540121 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:56:49.540121 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:56:49.541983 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:56:49.541983 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:56:49.541983 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:56:49.541983 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:56:49.541983 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:56:49.541983 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:56:49.541983 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:56:49.541983 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf8e51c6-99cf-49c6-b25b-89c3c7045e4e could not be found. Oct 24 08:56:49.541983 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:56:49.541983 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:56:49.541983 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:56:49.541983 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:56:49.541983 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:56:49.541983 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:56:49.541983 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:56:49.541983 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:56:49.541983 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf8e51c6-99cf-49c6-b25b-89c3c7045e4e could not be found. Oct 24 08:56:49.541983 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:56:49.543474 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-970feb28-8aee-4c6b-8a64-66d36e70ee0f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] Returning 404 to user: Instance cf8e51c6-99cf-49c6-b25b-89c3c7045e4e could not be found. {{(pid=125164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:56:49.543474 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-970feb28-8aee-4c6b-8a64-66d36e70ee0f tempest-AttachVolumeShelveTestJSON-2140536292 tempest-AttachVolumeShelveTestJSON-2140536292-project] 10.222.0.26 "GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e" status: 404 len: 111 microversion: 2.20 time: 0.030738 Oct 24 08:56:49.543474 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 458/907] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Oct 24 08:56:49 2022] GET /compute/v2.1/servers/cf8e51c6-99cf-49c6-b25b-89c3c7045e4e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 08:56:49.644584 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-6eb56b17-e493-4e95-972b-58a69a79e912 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c4228e92254a65ada3a0a777812103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2806e58f714af7a7f739a59d3dece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:49.653611 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-6eb56b17-e493-4e95-972b-58a69a79e912 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771" status: 200 len: 1258 microversion: 2.1 time: 0.264026 Oct 24 08:56:49.654345 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 450/908] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:49 2022] GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771 => generated 1258 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:50.677583 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-41cf38d8-f278-4e79-9c9d-8d54b284f05a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:50.678890 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-41cf38d8-f278-4e79-9c9d-8d54b284f05a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:50.685774 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-41cf38d8-f278-4e79-9c9d-8d54b284f05a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:50.686294 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-41cf38d8-f278-4e79-9c9d-8d54b284f05a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:50.686739 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-41cf38d8-f278-4e79-9c9d-8d54b284f05a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:50.687460 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-41cf38d8-f278-4e79-9c9d-8d54b284f05a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:50.688018 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-41cf38d8-f278-4e79-9c9d-8d54b284f05a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:50.688460 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-41cf38d8-f278-4e79-9c9d-8d54b284f05a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:50.831078 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-41cf38d8-f278-4e79-9c9d-8d54b284f05a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c4228e92254a65ada3a0a777812103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2806e58f714af7a7f739a59d3dece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:50.839467 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-41cf38d8-f278-4e79-9c9d-8d54b284f05a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771" status: 200 len: 1258 microversion: 2.1 time: 0.166177 Oct 24 08:56:50.840259 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 459/909] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:50 2022] GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771 => generated 1258 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:51.862412 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-fbf7819a-2eb6-406b-8edb-757fc16b8e6a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:51.863308 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-fbf7819a-2eb6-406b-8edb-757fc16b8e6a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:51.875292 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-fbf7819a-2eb6-406b-8edb-757fc16b8e6a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:51.875904 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-fbf7819a-2eb6-406b-8edb-757fc16b8e6a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:51.876816 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-fbf7819a-2eb6-406b-8edb-757fc16b8e6a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:51.877802 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-fbf7819a-2eb6-406b-8edb-757fc16b8e6a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:51.878327 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-fbf7819a-2eb6-406b-8edb-757fc16b8e6a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:51.878943 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-fbf7819a-2eb6-406b-8edb-757fc16b8e6a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:52.039095 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-fbf7819a-2eb6-406b-8edb-757fc16b8e6a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c4228e92254a65ada3a0a777812103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2806e58f714af7a7f739a59d3dece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:52.046882 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-fbf7819a-2eb6-406b-8edb-757fc16b8e6a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771" status: 200 len: 1258 microversion: 2.1 time: 0.188982 Oct 24 08:56:52.047455 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 451/910] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:51 2022] GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771 => generated 1258 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:53.078967 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-62f10c26-ee16-48fc-86fe-f663309c897c tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:53.080573 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-62f10c26-ee16-48fc-86fe-f663309c897c tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:53.093237 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-62f10c26-ee16-48fc-86fe-f663309c897c tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:53.093911 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-62f10c26-ee16-48fc-86fe-f663309c897c tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:53.094495 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-62f10c26-ee16-48fc-86fe-f663309c897c tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:53.095679 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-62f10c26-ee16-48fc-86fe-f663309c897c tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:53.096027 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-62f10c26-ee16-48fc-86fe-f663309c897c tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:53.097433 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-62f10c26-ee16-48fc-86fe-f663309c897c tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:53.330483 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-62f10c26-ee16-48fc-86fe-f663309c897c tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c4228e92254a65ada3a0a777812103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2806e58f714af7a7f739a59d3dece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:53.338230 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-62f10c26-ee16-48fc-86fe-f663309c897c tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771" status: 200 len: 1258 microversion: 2.1 time: 0.265406 Oct 24 08:56:53.338832 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 460/911] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:53 2022] GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771 => generated 1258 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:53.578283 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-c66a4f77-2c34-4b1d-a134-24d2b35b2444 req-32f68418-b69a-4427-8862-a3b6f9834c05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6a3aec5-42e2-40ea-a383-0e2bf1a52771", "name": "network-vif-plugged", "status": "completed", "tag": "d1cd745a-6478-4f59-ad2c-346b7fe41e9f"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:53.587260 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell0:SELECT=2 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:53.588366 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell0:SELECT=6 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:53.596671 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-c66a4f77-2c34-4b1d-a134-24d2b35b2444 req-32f68418-b69a-4427-8862-a3b6f9834c05 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:53.597581 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-c66a4f77-2c34-4b1d-a134-24d2b35b2444 req-32f68418-b69a-4427-8862-a3b6f9834c05 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:53.598265 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-c66a4f77-2c34-4b1d-a134-24d2b35b2444 req-32f68418-b69a-4427-8862-a3b6f9834c05 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:53.613022 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-c66a4f77-2c34-4b1d-a134-24d2b35b2444 req-32f68418-b69a-4427-8862-a3b6f9834c05 service nova] Creating event network-vif-plugged:d1cd745a-6478-4f59-ad2c-346b7fe41e9f for instance b6a3aec5-42e2-40ea-a383-0e2bf1a52771 on hv-cinder-maste Oct 24 08:56:53.618709 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-c66a4f77-2c34-4b1d-a134-24d2b35b2444 req-32f68418-b69a-4427-8862-a3b6f9834c05 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046245 Oct 24 08:56:53.619985 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 452/912] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:54.364950 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-dacfc9dd-1a0b-4523-ad87-f7e2ae15cf6c tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:54.365684 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-dacfc9dd-1a0b-4523-ad87-f7e2ae15cf6c tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:54.367931 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell0:SELECT=2 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:54.374029 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-dacfc9dd-1a0b-4523-ad87-f7e2ae15cf6c tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:54.374540 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-dacfc9dd-1a0b-4523-ad87-f7e2ae15cf6c tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:54.375018 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-dacfc9dd-1a0b-4523-ad87-f7e2ae15cf6c tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:54.375710 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-dacfc9dd-1a0b-4523-ad87-f7e2ae15cf6c tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:54.378431 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-dacfc9dd-1a0b-4523-ad87-f7e2ae15cf6c tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:54.378896 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-dacfc9dd-1a0b-4523-ad87-f7e2ae15cf6c tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:54.516617 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-dacfc9dd-1a0b-4523-ad87-f7e2ae15cf6c tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c4228e92254a65ada3a0a777812103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2806e58f714af7a7f739a59d3dece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:54.524640 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-dacfc9dd-1a0b-4523-ad87-f7e2ae15cf6c tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771" status: 200 len: 1258 microversion: 2.1 time: 0.164981 Oct 24 08:56:54.525212 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 461/913] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:54 2022] GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771 => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:55.552986 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-71deddb9-5c36-4201-adef-819453a193c0 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:55.554015 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-71deddb9-5c36-4201-adef-819453a193c0 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:55.563746 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-71deddb9-5c36-4201-adef-819453a193c0 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:55.564232 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-71deddb9-5c36-4201-adef-819453a193c0 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:55.564657 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-71deddb9-5c36-4201-adef-819453a193c0 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:55.565361 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-71deddb9-5c36-4201-adef-819453a193c0 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:55.565783 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-71deddb9-5c36-4201-adef-819453a193c0 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:55.566198 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-71deddb9-5c36-4201-adef-819453a193c0 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:55.711450 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-71deddb9-5c36-4201-adef-819453a193c0 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c4228e92254a65ada3a0a777812103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2806e58f714af7a7f739a59d3dece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:55.719502 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-71deddb9-5c36-4201-adef-819453a193c0 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771" status: 200 len: 1442 microversion: 2.1 time: 0.174850 Oct 24 08:56:55.720063 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 453/914] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:55 2022] GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771 => generated 1442 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:55.744794 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-cbdcf15c-2c47-497d-be77-b7267d3e726e tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:55.745717 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-cbdcf15c-2c47-497d-be77-b7267d3e726e tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:55.753727 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cbdcf15c-2c47-497d-be77-b7267d3e726e tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:55.754226 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cbdcf15c-2c47-497d-be77-b7267d3e726e tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:55.754689 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cbdcf15c-2c47-497d-be77-b7267d3e726e tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:55.755413 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cbdcf15c-2c47-497d-be77-b7267d3e726e tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:55.755865 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cbdcf15c-2c47-497d-be77-b7267d3e726e tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:55.756287 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cbdcf15c-2c47-497d-be77-b7267d3e726e tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:55.896428 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-cbdcf15c-2c47-497d-be77-b7267d3e726e tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c4228e92254a65ada3a0a777812103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2806e58f714af7a7f739a59d3dece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:55.904352 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-cbdcf15c-2c47-497d-be77-b7267d3e726e tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771" status: 200 len: 1442 microversion: 2.1 time: 0.166228 Oct 24 08:56:55.904909 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 462/915] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:55 2022] GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771 => generated 1442 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:56:58.016251 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-fe2d8969-32be-451c-8fb0-e4c7b0861f03 req-f97d05e9-1226-4914-8a9e-78e3d2d40d6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6a3aec5-42e2-40ea-a383-0e2bf1a52771", "tag": "d1cd745a-6478-4f59-ad2c-346b7fe41e9f"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:58.026919 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-fe2d8969-32be-451c-8fb0-e4c7b0861f03 req-f97d05e9-1226-4914-8a9e-78e3d2d40d6e service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:58.027400 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-fe2d8969-32be-451c-8fb0-e4c7b0861f03 req-f97d05e9-1226-4914-8a9e-78e3d2d40d6e service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:58.027830 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-fe2d8969-32be-451c-8fb0-e4c7b0861f03 req-f97d05e9-1226-4914-8a9e-78e3d2d40d6e service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:58.040559 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-fe2d8969-32be-451c-8fb0-e4c7b0861f03 req-f97d05e9-1226-4914-8a9e-78e3d2d40d6e service nova] Creating event network-changed:d1cd745a-6478-4f59-ad2c-346b7fe41e9f for instance b6a3aec5-42e2-40ea-a383-0e2bf1a52771 on hv-cinder-maste Oct 24 08:56:58.046039 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-fe2d8969-32be-451c-8fb0-e4c7b0861f03 req-f97d05e9-1226-4914-8a9e-78e3d2d40d6e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034229 Oct 24 08:56:58.046832 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 454/916] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:56:58.776444 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-260dd92a-1a7d-423f-8ec8-27d8b20ac099 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1316566007", "imageRef": "7eef2d62-12dc-4746-9cbd-870797d39b4d", "flavorRef": "452"}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:56:58.831803 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.network.neutron [None req-260dd92a-1a7d-423f-8ec8-27d8b20ac099 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] validate_networks() for None {{(pid=125164) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:56:59.109686 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-260dd92a-1a7d-423f-8ec8-27d8b20ac099 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Flavor limits 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:56:59.110105 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-260dd92a-1a7d-423f-8ec8-27d8b20ac099 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Image limits 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:56:59.110608 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-260dd92a-1a7d-423f-8ec8-27d8b20ac099 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Flavor pref 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:56:59.111045 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-260dd92a-1a7d-423f-8ec8-27d8b20ac099 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Image pref 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:56:59.111459 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-260dd92a-1a7d-423f-8ec8-27d8b20ac099 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:56:59.120760 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-260dd92a-1a7d-423f-8ec8-27d8b20ac099 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:59.121246 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-260dd92a-1a7d-423f-8ec8-27d8b20ac099 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:59.121682 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-260dd92a-1a7d-423f-8ec8-27d8b20ac099 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:59.122438 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-260dd92a-1a7d-423f-8ec8-27d8b20ac099 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:56:59.122939 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-260dd92a-1a7d-423f-8ec8-27d8b20ac099 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:56:59.123368 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-260dd92a-1a7d-423f-8ec8-27d8b20ac099 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:56:59.140644 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.quota [None req-260dd92a-1a7d-423f-8ec8-27d8b20ac099 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Getting quotas for project 77df0bbca3c740b789fe7e0ea62f9e3a. Resources: {'ram', 'cores', 'instances'} {{(pid=125164) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:56:59.144842 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.quota [None req-260dd92a-1a7d-423f-8ec8-27d8b20ac099 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Getting quotas for user 8926edfa5bbd48ae91bca6e01dd0e642 and project 77df0bbca3c740b789fe7e0ea62f9e3a. Resources: {'ram', 'cores', 'instances'} {{(pid=125164) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:56:59.156320 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-260dd92a-1a7d-423f-8ec8-27d8b20ac099 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Going to run 1 instances... {{(pid=125164) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:56:59.158663 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-260dd92a-1a7d-423f-8ec8-27d8b20ac099 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] [instance: d77f86a2-db3a-4c25-80a6-988bbff57b50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7eef2d62-12dc-4746-9cbd-870797d39b4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125164) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:56:59.206944 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-260dd92a-1a7d-423f-8ec8-27d8b20ac099 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.434607 Oct 24 08:56:59.207721 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 463/917] 10.222.0.26 () {60 vars in 1147 bytes} [Mon Oct 24 08:56:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:56:59.223090 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-64d7b854-b6fe-40b7-92e0-47703062258a tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:56:59.223779 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-64d7b854-b6fe-40b7-92e0-47703062258a tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] [instance: d77f86a2-db3a-4c25-80a6-988bbff57b50] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:56:59.290890 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-64d7b854-b6fe-40b7-92e0-47703062258a tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8926edfa5bbd48ae91bca6e01dd0e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77df0bbca3c740b789fe7e0ea62f9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:56:59.297745 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-64d7b854-b6fe-40b7-92e0-47703062258a tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] 10.222.0.26 "GET /compute/v2.1/servers/d77f86a2-db3a-4c25-80a6-988bbff57b50" status: 200 len: 1215 microversion: 2.1 time: 0.079652 Oct 24 08:56:59.298316 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 455/918] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:56:59 2022] GET /compute/v2.1/servers/d77f86a2-db3a-4c25-80a6-988bbff57b50 => generated 1215 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:00.321828 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-2cb9d9b1-ac01-4b9c-ae9d-34b34bb1f170 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:00.322462 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-2cb9d9b1-ac01-4b9c-ae9d-34b34bb1f170 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] [instance: d77f86a2-db3a-4c25-80a6-988bbff57b50] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:00.330254 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2cb9d9b1-ac01-4b9c-ae9d-34b34bb1f170 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:00.330786 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2cb9d9b1-ac01-4b9c-ae9d-34b34bb1f170 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:00.331265 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2cb9d9b1-ac01-4b9c-ae9d-34b34bb1f170 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:00.331963 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2cb9d9b1-ac01-4b9c-ae9d-34b34bb1f170 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:00.332415 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2cb9d9b1-ac01-4b9c-ae9d-34b34bb1f170 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:00.332839 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-2cb9d9b1-ac01-4b9c-ae9d-34b34bb1f170 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:00.418190 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-2cb9d9b1-ac01-4b9c-ae9d-34b34bb1f170 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8926edfa5bbd48ae91bca6e01dd0e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77df0bbca3c740b789fe7e0ea62f9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:00.431644 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-2cb9d9b1-ac01-4b9c-ae9d-34b34bb1f170 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] 10.222.0.26 "GET /compute/v2.1/servers/d77f86a2-db3a-4c25-80a6-988bbff57b50" status: 200 len: 1275 microversion: 2.1 time: 0.114425 Oct 24 08:57:00.442237 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 464/919] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:00 2022] GET /compute/v2.1/servers/d77f86a2-db3a-4c25-80a6-988bbff57b50 => generated 1275 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:01.455949 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-ed18f87b-de50-4cfc-93ae-7717cffd6e1c tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:01.456872 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-ed18f87b-de50-4cfc-93ae-7717cffd6e1c tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] [instance: d77f86a2-db3a-4c25-80a6-988bbff57b50] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:01.464032 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ed18f87b-de50-4cfc-93ae-7717cffd6e1c tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:01.464605 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ed18f87b-de50-4cfc-93ae-7717cffd6e1c tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:01.465104 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ed18f87b-de50-4cfc-93ae-7717cffd6e1c tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:01.465879 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ed18f87b-de50-4cfc-93ae-7717cffd6e1c tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:01.466338 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ed18f87b-de50-4cfc-93ae-7717cffd6e1c tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:01.466843 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ed18f87b-de50-4cfc-93ae-7717cffd6e1c tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:01.787203 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-ed18f87b-de50-4cfc-93ae-7717cffd6e1c tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8926edfa5bbd48ae91bca6e01dd0e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77df0bbca3c740b789fe7e0ea62f9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:01.795625 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-ed18f87b-de50-4cfc-93ae-7717cffd6e1c tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] 10.222.0.26 "GET /compute/v2.1/servers/d77f86a2-db3a-4c25-80a6-988bbff57b50" status: 200 len: 1315 microversion: 2.1 time: 0.343600 Oct 24 08:57:01.796506 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 456/920] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:01 2022] GET /compute/v2.1/servers/d77f86a2-db3a-4c25-80a6-988bbff57b50 => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:02.192617 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-6765ece0-44ee-4a8a-84ac-77241de89d40 req-1ccb63c1-02fb-44a4-84c2-38e447282079 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d77f86a2-db3a-4c25-80a6-988bbff57b50", "tag": "8d96abb3-7daf-43a7-be39-bda17e2c3b13"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:57:02.212588 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-6765ece0-44ee-4a8a-84ac-77241de89d40 req-1ccb63c1-02fb-44a4-84c2-38e447282079 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:02.213302 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-6765ece0-44ee-4a8a-84ac-77241de89d40 req-1ccb63c1-02fb-44a4-84c2-38e447282079 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:02.213948 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-6765ece0-44ee-4a8a-84ac-77241de89d40 req-1ccb63c1-02fb-44a4-84c2-38e447282079 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:02.226642 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-6765ece0-44ee-4a8a-84ac-77241de89d40 req-1ccb63c1-02fb-44a4-84c2-38e447282079 service nova] Creating event network-changed:8d96abb3-7daf-43a7-be39-bda17e2c3b13 for instance d77f86a2-db3a-4c25-80a6-988bbff57b50 on hv-cinder-maste Oct 24 08:57:02.232920 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-6765ece0-44ee-4a8a-84ac-77241de89d40 req-1ccb63c1-02fb-44a4-84c2-38e447282079 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045937 Oct 24 08:57:02.234074 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 465/921] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:57:02.823457 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-74fadb83-5082-497e-a6f8-cecc42910c41 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:02.824246 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-74fadb83-5082-497e-a6f8-cecc42910c41 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] [instance: d77f86a2-db3a-4c25-80a6-988bbff57b50] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:02.830985 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-74fadb83-5082-497e-a6f8-cecc42910c41 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:02.831468 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-74fadb83-5082-497e-a6f8-cecc42910c41 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:02.831953 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-74fadb83-5082-497e-a6f8-cecc42910c41 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:02.832640 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-74fadb83-5082-497e-a6f8-cecc42910c41 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:02.833055 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-74fadb83-5082-497e-a6f8-cecc42910c41 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:02.833470 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-74fadb83-5082-497e-a6f8-cecc42910c41 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:02.971838 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-74fadb83-5082-497e-a6f8-cecc42910c41 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8926edfa5bbd48ae91bca6e01dd0e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77df0bbca3c740b789fe7e0ea62f9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:02.980227 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-74fadb83-5082-497e-a6f8-cecc42910c41 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] 10.222.0.26 "GET /compute/v2.1/servers/d77f86a2-db3a-4c25-80a6-988bbff57b50" status: 200 len: 1315 microversion: 2.1 time: 0.161036 Oct 24 08:57:02.981549 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 457/922] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:02 2022] GET /compute/v2.1/servers/d77f86a2-db3a-4c25-80a6-988bbff57b50 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:04.004319 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-bb2fdea8-6fc9-4ce4-aff1-08b86223ba1f tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:04.005602 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-bb2fdea8-6fc9-4ce4-aff1-08b86223ba1f tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] [instance: d77f86a2-db3a-4c25-80a6-988bbff57b50] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:04.012646 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bb2fdea8-6fc9-4ce4-aff1-08b86223ba1f tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:04.013244 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bb2fdea8-6fc9-4ce4-aff1-08b86223ba1f tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:04.013612 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bb2fdea8-6fc9-4ce4-aff1-08b86223ba1f tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:04.014521 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bb2fdea8-6fc9-4ce4-aff1-08b86223ba1f tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:04.015000 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bb2fdea8-6fc9-4ce4-aff1-08b86223ba1f tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:04.015492 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-bb2fdea8-6fc9-4ce4-aff1-08b86223ba1f tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:04.152920 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-bb2fdea8-6fc9-4ce4-aff1-08b86223ba1f tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8926edfa5bbd48ae91bca6e01dd0e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77df0bbca3c740b789fe7e0ea62f9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:04.161937 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-bb2fdea8-6fc9-4ce4-aff1-08b86223ba1f tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] 10.222.0.26 "GET /compute/v2.1/servers/d77f86a2-db3a-4c25-80a6-988bbff57b50" status: 200 len: 1315 microversion: 2.1 time: 0.161828 Oct 24 08:57:04.162782 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 466/923] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:03 2022] GET /compute/v2.1/servers/d77f86a2-db3a-4c25-80a6-988bbff57b50 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:05.185332 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-7777b345-0add-4362-ae2a-f36bf844a332 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:05.186174 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-7777b345-0add-4362-ae2a-f36bf844a332 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] [instance: d77f86a2-db3a-4c25-80a6-988bbff57b50] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:05.193745 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7777b345-0add-4362-ae2a-f36bf844a332 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:05.194250 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7777b345-0add-4362-ae2a-f36bf844a332 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:05.194654 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7777b345-0add-4362-ae2a-f36bf844a332 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:05.195374 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7777b345-0add-4362-ae2a-f36bf844a332 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:05.195817 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7777b345-0add-4362-ae2a-f36bf844a332 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:05.196232 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-7777b345-0add-4362-ae2a-f36bf844a332 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:05.327259 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-7777b345-0add-4362-ae2a-f36bf844a332 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8926edfa5bbd48ae91bca6e01dd0e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77df0bbca3c740b789fe7e0ea62f9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:05.335159 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-7777b345-0add-4362-ae2a-f36bf844a332 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] 10.222.0.26 "GET /compute/v2.1/servers/d77f86a2-db3a-4c25-80a6-988bbff57b50" status: 200 len: 1315 microversion: 2.1 time: 0.153670 Oct 24 08:57:05.335745 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 458/924] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:05 2022] GET /compute/v2.1/servers/d77f86a2-db3a-4c25-80a6-988bbff57b50 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:06.358215 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-99714ea7-8c9a-4506-bd3e-88920e0a404b tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:06.359414 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-99714ea7-8c9a-4506-bd3e-88920e0a404b tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] [instance: d77f86a2-db3a-4c25-80a6-988bbff57b50] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:06.366142 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-99714ea7-8c9a-4506-bd3e-88920e0a404b tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:06.366393 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-99714ea7-8c9a-4506-bd3e-88920e0a404b tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:06.366867 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-99714ea7-8c9a-4506-bd3e-88920e0a404b tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:06.367790 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-99714ea7-8c9a-4506-bd3e-88920e0a404b tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:06.368010 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-99714ea7-8c9a-4506-bd3e-88920e0a404b tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:06.368433 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-99714ea7-8c9a-4506-bd3e-88920e0a404b tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:06.758038 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-99714ea7-8c9a-4506-bd3e-88920e0a404b tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8926edfa5bbd48ae91bca6e01dd0e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77df0bbca3c740b789fe7e0ea62f9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:06.765925 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-99714ea7-8c9a-4506-bd3e-88920e0a404b tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] 10.222.0.26 "GET /compute/v2.1/servers/d77f86a2-db3a-4c25-80a6-988bbff57b50" status: 200 len: 1315 microversion: 2.1 time: 0.411537 Oct 24 08:57:06.766467 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 467/925] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:06 2022] GET /compute/v2.1/servers/d77f86a2-db3a-4c25-80a6-988bbff57b50 => generated 1315 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:07.570611 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-9e8407aa-9104-46f7-aa6a-f27bec94c08a req-d2bbfc4b-69d9-4ba4-a58d-3bb0abbdfc3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d77f86a2-db3a-4c25-80a6-988bbff57b50", "name": "network-vif-plugged", "status": "completed", "tag": "8d96abb3-7daf-43a7-be39-bda17e2c3b13"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:57:07.588151 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-9e8407aa-9104-46f7-aa6a-f27bec94c08a req-d2bbfc4b-69d9-4ba4-a58d-3bb0abbdfc3a service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:07.588632 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-9e8407aa-9104-46f7-aa6a-f27bec94c08a req-d2bbfc4b-69d9-4ba4-a58d-3bb0abbdfc3a service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:07.589195 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-9e8407aa-9104-46f7-aa6a-f27bec94c08a req-d2bbfc4b-69d9-4ba4-a58d-3bb0abbdfc3a service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:07.601220 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-9e8407aa-9104-46f7-aa6a-f27bec94c08a req-d2bbfc4b-69d9-4ba4-a58d-3bb0abbdfc3a service nova] Creating event network-vif-plugged:8d96abb3-7daf-43a7-be39-bda17e2c3b13 for instance d77f86a2-db3a-4c25-80a6-988bbff57b50 on hv-cinder-maste Oct 24 08:57:07.606434 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-9e8407aa-9104-46f7-aa6a-f27bec94c08a req-d2bbfc4b-69d9-4ba4-a58d-3bb0abbdfc3a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039437 Oct 24 08:57:07.607082 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 459/926] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:57:07.790451 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-9c7b6e3a-fe7d-4616-9a83-dddfc8243c2f tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:07.791074 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-9c7b6e3a-fe7d-4616-9a83-dddfc8243c2f tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] [instance: d77f86a2-db3a-4c25-80a6-988bbff57b50] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:07.798704 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9c7b6e3a-fe7d-4616-9a83-dddfc8243c2f tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:07.799512 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9c7b6e3a-fe7d-4616-9a83-dddfc8243c2f tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:07.800043 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9c7b6e3a-fe7d-4616-9a83-dddfc8243c2f tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:07.800752 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9c7b6e3a-fe7d-4616-9a83-dddfc8243c2f tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:07.801202 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9c7b6e3a-fe7d-4616-9a83-dddfc8243c2f tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:07.801626 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9c7b6e3a-fe7d-4616-9a83-dddfc8243c2f tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:07.959631 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-9c7b6e3a-fe7d-4616-9a83-dddfc8243c2f tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8926edfa5bbd48ae91bca6e01dd0e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77df0bbca3c740b789fe7e0ea62f9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:07.967483 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-9c7b6e3a-fe7d-4616-9a83-dddfc8243c2f tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] 10.222.0.26 "GET /compute/v2.1/servers/d77f86a2-db3a-4c25-80a6-988bbff57b50" status: 200 len: 1315 microversion: 2.1 time: 0.181931 Oct 24 08:57:07.968436 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 468/927] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:07 2022] GET /compute/v2.1/servers/d77f86a2-db3a-4c25-80a6-988bbff57b50 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:08.990529 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-0b62abcb-298b-4c8f-bc73-52ce7e180242 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:08.991374 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-0b62abcb-298b-4c8f-bc73-52ce7e180242 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] [instance: d77f86a2-db3a-4c25-80a6-988bbff57b50] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:08.997980 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0b62abcb-298b-4c8f-bc73-52ce7e180242 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:08.998561 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0b62abcb-298b-4c8f-bc73-52ce7e180242 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:08.999098 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0b62abcb-298b-4c8f-bc73-52ce7e180242 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:08.999842 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0b62abcb-298b-4c8f-bc73-52ce7e180242 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:09.000505 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0b62abcb-298b-4c8f-bc73-52ce7e180242 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:09.000940 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-0b62abcb-298b-4c8f-bc73-52ce7e180242 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:09.129618 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-0b62abcb-298b-4c8f-bc73-52ce7e180242 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8926edfa5bbd48ae91bca6e01dd0e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77df0bbca3c740b789fe7e0ea62f9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:09.137344 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-0b62abcb-298b-4c8f-bc73-52ce7e180242 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] 10.222.0.26 "GET /compute/v2.1/servers/d77f86a2-db3a-4c25-80a6-988bbff57b50" status: 200 len: 1315 microversion: 2.1 time: 0.151497 Oct 24 08:57:09.137897 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 460/928] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:08 2022] GET /compute/v2.1/servers/d77f86a2-db3a-4c25-80a6-988bbff57b50 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:10.167508 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-ae791116-af90-4dc2-a656-75bfbc2f51c5 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:10.168764 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-ae791116-af90-4dc2-a656-75bfbc2f51c5 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] [instance: d77f86a2-db3a-4c25-80a6-988bbff57b50] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:10.173238 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell0:SELECT=2 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:10.174879 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell0:SELECT=6 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:10.181147 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ae791116-af90-4dc2-a656-75bfbc2f51c5 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:10.181631 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ae791116-af90-4dc2-a656-75bfbc2f51c5 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:10.182062 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ae791116-af90-4dc2-a656-75bfbc2f51c5 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:10.182759 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ae791116-af90-4dc2-a656-75bfbc2f51c5 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:10.183242 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ae791116-af90-4dc2-a656-75bfbc2f51c5 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:10.183649 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ae791116-af90-4dc2-a656-75bfbc2f51c5 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:10.319029 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-ae791116-af90-4dc2-a656-75bfbc2f51c5 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8926edfa5bbd48ae91bca6e01dd0e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77df0bbca3c740b789fe7e0ea62f9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:10.322472 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell1:SELECT=100 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:10.327575 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-ae791116-af90-4dc2-a656-75bfbc2f51c5 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] 10.222.0.26 "GET /compute/v2.1/servers/d77f86a2-db3a-4c25-80a6-988bbff57b50" status: 200 len: 1464 microversion: 2.1 time: 0.168984 Oct 24 08:57:10.328149 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 469/929] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:10 2022] GET /compute/v2.1/servers/d77f86a2-db3a-4c25-80a6-988bbff57b50 => generated 1464 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:10.373150 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-aa3ba93e-c09a-4b99-a623-9f116c8b00c5 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:10.373637 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-aa3ba93e-c09a-4b99-a623-9f116c8b00c5 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] [instance: d77f86a2-db3a-4c25-80a6-988bbff57b50] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:10.375638 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell0:SELECT=2 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:10.381267 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-aa3ba93e-c09a-4b99-a623-9f116c8b00c5 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:10.381756 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-aa3ba93e-c09a-4b99-a623-9f116c8b00c5 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:10.382193 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-aa3ba93e-c09a-4b99-a623-9f116c8b00c5 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:10.382954 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-aa3ba93e-c09a-4b99-a623-9f116c8b00c5 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:10.383411 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-aa3ba93e-c09a-4b99-a623-9f116c8b00c5 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:10.383844 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-aa3ba93e-c09a-4b99-a623-9f116c8b00c5 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:10.409601 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-aa3ba93e-c09a-4b99-a623-9f116c8b00c5 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] [instance: d77f86a2-db3a-4c25-80a6-988bbff57b50] Going to try to terminate instance {{(pid=125165) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:57:10.412400 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:10.491514 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-aa3ba93e-c09a-4b99-a623-9f116c8b00c5 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d77f86a2-db3a-4c25-80a6-988bbff57b50" status: 204 len: 0 microversion: 2.1 time: 0.121898 Oct 24 08:57:10.492270 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 461/930] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Oct 24 08:57:10 2022] DELETE /compute/v2.1/servers/d77f86a2-db3a-4c25-80a6-988bbff57b50 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:57:10.501835 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-231c98b7-42e1-4235-b61c-fe4ab9050098 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:10.502753 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-231c98b7-42e1-4235-b61c-fe4ab9050098 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] [instance: d77f86a2-db3a-4c25-80a6-988bbff57b50] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:10.508901 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-231c98b7-42e1-4235-b61c-fe4ab9050098 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:10.509382 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-231c98b7-42e1-4235-b61c-fe4ab9050098 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:10.509814 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-231c98b7-42e1-4235-b61c-fe4ab9050098 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:10.510500 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-231c98b7-42e1-4235-b61c-fe4ab9050098 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:10.510950 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-231c98b7-42e1-4235-b61c-fe4ab9050098 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:10.511573 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-231c98b7-42e1-4235-b61c-fe4ab9050098 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:10.651601 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-231c98b7-42e1-4235-b61c-fe4ab9050098 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8926edfa5bbd48ae91bca6e01dd0e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77df0bbca3c740b789fe7e0ea62f9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:10.661105 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-231c98b7-42e1-4235-b61c-fe4ab9050098 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] 10.222.0.26 "GET /compute/v2.1/servers/d77f86a2-db3a-4c25-80a6-988bbff57b50" status: 200 len: 1470 microversion: 2.1 time: 0.164214 Oct 24 08:57:10.661685 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 470/931] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:10 2022] GET /compute/v2.1/servers/d77f86a2-db3a-4c25-80a6-988bbff57b50 => generated 1470 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:11.690149 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-2ebddffd-10c9-45a7-bb2a-a8ed3164fda7 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:11.691337 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-2ebddffd-10c9-45a7-bb2a-a8ed3164fda7 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] [instance: d77f86a2-db3a-4c25-80a6-988bbff57b50] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:11.695061 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:11.703672 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2ebddffd-10c9-45a7-bb2a-a8ed3164fda7 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:11.704177 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2ebddffd-10c9-45a7-bb2a-a8ed3164fda7 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:11.704590 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2ebddffd-10c9-45a7-bb2a-a8ed3164fda7 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:11.705275 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2ebddffd-10c9-45a7-bb2a-a8ed3164fda7 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:11.705720 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2ebddffd-10c9-45a7-bb2a-a8ed3164fda7 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:11.706139 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2ebddffd-10c9-45a7-bb2a-a8ed3164fda7 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:11.845453 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-2ebddffd-10c9-45a7-bb2a-a8ed3164fda7 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8926edfa5bbd48ae91bca6e01dd0e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77df0bbca3c740b789fe7e0ea62f9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:11.853967 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-2ebddffd-10c9-45a7-bb2a-a8ed3164fda7 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] 10.222.0.26 "GET /compute/v2.1/servers/d77f86a2-db3a-4c25-80a6-988bbff57b50" status: 200 len: 1470 microversion: 2.1 time: 0.171060 Oct 24 08:57:11.854779 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 462/932] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:11 2022] GET /compute/v2.1/servers/d77f86a2-db3a-4c25-80a6-988bbff57b50 => generated 1470 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:12.664250 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-a722a976-a1d9-4d0d-b166-2587bbad0397 req-7f857f2e-be39-4c25-8b92-b6d96b4fa0d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d77f86a2-db3a-4c25-80a6-988bbff57b50", "name": "network-vif-deleted", "tag": "8d96abb3-7daf-43a7-be39-bda17e2c3b13"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:57:12.671020 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:12.678220 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-a722a976-a1d9-4d0d-b166-2587bbad0397 req-7f857f2e-be39-4c25-8b92-b6d96b4fa0d7 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:12.678702 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-a722a976-a1d9-4d0d-b166-2587bbad0397 req-7f857f2e-be39-4c25-8b92-b6d96b4fa0d7 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:12.679157 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-a722a976-a1d9-4d0d-b166-2587bbad0397 req-7f857f2e-be39-4c25-8b92-b6d96b4fa0d7 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:12.693246 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-a722a976-a1d9-4d0d-b166-2587bbad0397 req-7f857f2e-be39-4c25-8b92-b6d96b4fa0d7 service nova] Creating event network-vif-deleted:8d96abb3-7daf-43a7-be39-bda17e2c3b13 for instance d77f86a2-db3a-4c25-80a6-988bbff57b50 on hv-cinder-maste Oct 24 08:57:12.702794 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-a722a976-a1d9-4d0d-b166-2587bbad0397 req-7f857f2e-be39-4c25-8b92-b6d96b4fa0d7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042349 Oct 24 08:57:12.703418 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 471/933] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:57:12.877855 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-fedec191-cb29-437f-87c9-02e3ebac91f8 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:12.878463 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-fedec191-cb29-437f-87c9-02e3ebac91f8 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] [instance: d77f86a2-db3a-4c25-80a6-988bbff57b50] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:12.885210 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-fedec191-cb29-437f-87c9-02e3ebac91f8 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:12.885789 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-fedec191-cb29-437f-87c9-02e3ebac91f8 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:12.886287 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-fedec191-cb29-437f-87c9-02e3ebac91f8 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:12.887073 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-fedec191-cb29-437f-87c9-02e3ebac91f8 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:12.887585 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-fedec191-cb29-437f-87c9-02e3ebac91f8 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:12.888072 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-fedec191-cb29-437f-87c9-02e3ebac91f8 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:12.919583 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-fedec191-cb29-437f-87c9-02e3ebac91f8 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:12.920117 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-fedec191-cb29-437f-87c9-02e3ebac91f8 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:12.920550 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-fedec191-cb29-437f-87c9-02e3ebac91f8 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:12.921077 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.objects.instance [None req-fedec191-cb29-437f-87c9-02e3ebac91f8 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lazy-loading 'fault' on Instance uuid d77f86a2-db3a-4c25-80a6-988bbff57b50 {{(pid=125165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:57:12.961878 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-fedec191-cb29-437f-87c9-02e3ebac91f8 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8926edfa5bbd48ae91bca6e01dd0e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77df0bbca3c740b789fe7e0ea62f9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:12.969802 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-fedec191-cb29-437f-87c9-02e3ebac91f8 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] 10.222.0.26 "GET /compute/v2.1/servers/d77f86a2-db3a-4c25-80a6-988bbff57b50" status: 200 len: 1305 microversion: 2.1 time: 0.096173 Oct 24 08:57:12.970358 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 463/934] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:12 2022] GET /compute/v2.1/servers/d77f86a2-db3a-4c25-80a6-988bbff57b50 => generated 1305 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:13.998710 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-3726777a-602f-4b55-8968-0c4423973a41 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:13.999889 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-3726777a-602f-4b55-8968-0c4423973a41 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] [instance: d77f86a2-db3a-4c25-80a6-988bbff57b50] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:14.010233 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3726777a-602f-4b55-8968-0c4423973a41 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:14.011103 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3726777a-602f-4b55-8968-0c4423973a41 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:14.011819 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3726777a-602f-4b55-8968-0c4423973a41 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:14.013059 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3726777a-602f-4b55-8968-0c4423973a41 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:14.013816 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3726777a-602f-4b55-8968-0c4423973a41 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:14.014526 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3726777a-602f-4b55-8968-0c4423973a41 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:14.030147 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.wsgi [None req-3726777a-602f-4b55-8968-0c4423973a41 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] HTTP exception thrown: Instance d77f86a2-db3a-4c25-80a6-988bbff57b50 could not be found. Oct 24 08:57:14.031836 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-3726777a-602f-4b55-8968-0c4423973a41 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Request method failure captured: Oct 24 08:57:14.031836 dv-cinder-master-3-smb devstack@n-api.service[125164]: request: GET /compute/v2.1/servers/d77f86a2-db3a-4c25-80a6-988bbff57b50 HTTP/1.1 Oct 24 08:57:14.031836 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept: application/json Oct 24 08:57:14.031836 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept-Encoding: identity Oct 24 08:57:14.031836 dv-cinder-master-3-smb devstack@n-api.service[125164]: Connection: close Oct 24 08:57:14.031836 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Length: 0 Oct 24 08:57:14.031836 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Type: application/json Oct 24 08:57:14.031836 dv-cinder-master-3-smb devstack@n-api.service[125164]: Host: 10.222.0.26 Oct 24 08:57:14.031836 dv-cinder-master-3-smb devstack@n-api.service[125164]: Openstack-System-Scope: None Oct 24 08:57:14.031836 dv-cinder-master-3-smb devstack@n-api.service[125164]: User-Agent: python-urllib3/1.26.12 Oct 24 08:57:14.031836 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Auth-Token: gAAAAABjVlNZSq_PCcZpABRLcavhccKweCalGNZuxKctePbDqQc0w_OwHw4gA8gX-7KI6W2JOf0_qvftDzifFwzxkAvjrtZbuPgFgCr8Dh82wnfgWeIDuBEKbwdMjXFjfVw1wnFENpthJTJ-YzRvMm3C_i8icockLzPdPyYgMZk64167QHOF2Jc Oct 24 08:57:14.031836 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Id: None Oct 24 08:57:14.031836 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Name: None Oct 24 08:57:14.031836 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Identity-Status: Confirmed Oct 24 08:57:14.031836 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Is-Admin-Project: True Oct 24 08:57:14.031836 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Id: default Oct 24 08:57:14.031836 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Name: Default Oct 24 08:57:14.031836 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Id: 77df0bbca3c740b789fe7e0ea62f9e3a Oct 24 08:57:14.031836 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Name: tempest-VolumesNegativeTest-295910251 Oct 24 08:57:14.031836 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Role: reader,member Oct 24 08:57:14.031836 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Roles: reader,member Oct 24 08:57:14.033433 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_77df0bbca3c740b789fe7e0ea62f9e3a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/77df0bbca3c740b789fe7e0ea62f9e3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/77df0bbca3c740b789fe7e0ea62f9e3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/77df0bbca3c740b789fe7e0ea62f9e3a"}]}] Oct 24 08:57:14.033433 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant: tempest-VolumesNegativeTest-295910251 Oct 24 08:57:14.033433 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Id: 77df0bbca3c740b789fe7e0ea62f9e3a Oct 24 08:57:14.033433 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Name: tempest-VolumesNegativeTest-295910251 Oct 24 08:57:14.033433 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User: tempest-VolumesNegativeTest-295910251-project Oct 24 08:57:14.033433 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Id: default Oct 24 08:57:14.033433 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Name: Default Oct 24 08:57:14.033433 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Id: 8926edfa5bbd48ae91bca6e01dd0e642 Oct 24 08:57:14.033433 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Name: tempest-VolumesNegativeTest-295910251-project Oct 24 08:57:14.033433 dv-cinder-master-3-smb devstack@n-api.service[125164]: method: > Oct 24 08:57:14.033433 dv-cinder-master-3-smb devstack@n-api.service[125164]: exception: Instance d77f86a2-db3a-4c25-80a6-988bbff57b50 could not be found. Oct 24 08:57:14.033433 dv-cinder-master-3-smb devstack@n-api.service[125164]: action_args: {'id': 'd77f86a2-db3a-4c25-80a6-988bbff57b50'} Oct 24 08:57:14.034360 dv-cinder-master-3-smb devstack@n-api.service[125164]: {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:57:14.034360 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:14.034360 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:57:14.034360 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:57:14.034360 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:57:14.034360 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:57:14.034360 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:57:14.034360 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:57:14.034360 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:57:14.034360 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:57:14.034360 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d77f86a2-db3a-4c25-80a6-988bbff57b50 could not be found. Oct 24 08:57:14.034360 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:57:14.034360 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:57:14.034360 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:57:14.034360 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:14.034360 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:57:14.034360 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:57:14.034360 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:57:14.034360 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:57:14.034360 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:57:14.035936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:57:14.035936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:57:14.035936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:57:14.035936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:57:14.035936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:57:14.035936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:57:14.035936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:57:14.035936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d77f86a2-db3a-4c25-80a6-988bbff57b50 could not be found. Oct 24 08:57:14.035936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:57:14.035936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:57:14.035936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:57:14.035936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:57:14.035936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:57:14.035936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:57:14.035936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:57:14.035936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:57:14.035936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d77f86a2-db3a-4c25-80a6-988bbff57b50 could not be found. Oct 24 08:57:14.035936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:57:14.037316 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-3726777a-602f-4b55-8968-0c4423973a41 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] Returning 404 to user: Instance d77f86a2-db3a-4c25-80a6-988bbff57b50 could not be found. {{(pid=125164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:57:14.037316 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-3726777a-602f-4b55-8968-0c4423973a41 tempest-VolumesNegativeTest-295910251 tempest-VolumesNegativeTest-295910251-project] 10.222.0.26 "GET /compute/v2.1/servers/d77f86a2-db3a-4c25-80a6-988bbff57b50" status: 404 len: 111 microversion: 2.1 time: 0.042393 Oct 24 08:57:14.037316 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 472/935] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:13 2022] GET /compute/v2.1/servers/d77f86a2-db3a-4c25-80a6-988bbff57b50 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:57:22.460683 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-15089a2f-839a-42cc-9631-ff7f1cff9415 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-392494309", "imageRef": "7eef2d62-12dc-4746-9cbd-870797d39b4d", "flavorRef": "452", "networks": [{"uuid": "ac41dbd8-bda4-4bbc-b503-ed53ba1b0720"}]}} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:57:22.517581 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.network.neutron [None req-15089a2f-839a-42cc-9631-ff7f1cff9415 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] validate_networks() for [('ac41dbd8-bda4-4bbc-b503-ed53ba1b0720', None, None, None, None, None)] {{(pid=125165) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:57:22.862431 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-15089a2f-839a-42cc-9631-ff7f1cff9415 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Flavor limits 0:0:0 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:57:22.862891 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-15089a2f-839a-42cc-9631-ff7f1cff9415 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Image limits 0:0:0 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:57:22.863361 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-15089a2f-839a-42cc-9631-ff7f1cff9415 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Flavor pref 0:0:0 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:57:22.863757 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-15089a2f-839a-42cc-9631-ff7f1cff9415 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Image pref 0:0:0 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:57:22.864215 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.virt.hardware [None req-15089a2f-839a-42cc-9631-ff7f1cff9415 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:57:22.873699 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-15089a2f-839a-42cc-9631-ff7f1cff9415 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:22.874242 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-15089a2f-839a-42cc-9631-ff7f1cff9415 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:22.874598 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-15089a2f-839a-42cc-9631-ff7f1cff9415 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:22.875346 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-15089a2f-839a-42cc-9631-ff7f1cff9415 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:22.875792 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-15089a2f-839a-42cc-9631-ff7f1cff9415 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:22.876210 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-15089a2f-839a-42cc-9631-ff7f1cff9415 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:22.893182 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.quota [None req-15089a2f-839a-42cc-9631-ff7f1cff9415 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Getting quotas for project 0b1b162d022d4c5ebd8c62dcad277727. Resources: {'ram', 'cores', 'instances'} {{(pid=125165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:57:22.897520 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.quota [None req-15089a2f-839a-42cc-9631-ff7f1cff9415 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Getting quotas for user a49947bfa2a5482d919ba0d4744553c7 and project 0b1b162d022d4c5ebd8c62dcad277727. Resources: {'ram', 'cores', 'instances'} {{(pid=125165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:57:22.909245 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-15089a2f-839a-42cc-9631-ff7f1cff9415 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Going to run 1 instances... {{(pid=125165) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:57:22.911557 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-15089a2f-839a-42cc-9631-ff7f1cff9415 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 776274a0-88c0-44b4-a063-82ee7044718d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7eef2d62-12dc-4746-9cbd-870797d39b4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125165) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:57:22.960872 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-15089a2f-839a-42cc-9631-ff7f1cff9415 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.504019 Oct 24 08:57:22.961550 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 464/936] 10.222.0.26 () {60 vars in 1147 bytes} [Mon Oct 24 08:57:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:57:22.977770 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-415a403a-1eea-4fd8-9078-1a6defd7a85b tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:22.978405 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-415a403a-1eea-4fd8-9078-1a6defd7a85b tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 776274a0-88c0-44b4-a063-82ee7044718d] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:23.032699 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-415a403a-1eea-4fd8-9078-1a6defd7a85b tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49947bfa2a5482d919ba0d4744553c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1b162d022d4c5ebd8c62dcad277727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:23.039859 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-415a403a-1eea-4fd8-9078-1a6defd7a85b tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "GET /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d" status: 200 len: 1218 microversion: 2.1 time: 0.067675 Oct 24 08:57:23.040366 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 473/937] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:22 2022] GET /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:24.065186 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-069f56c3-8273-4c8d-9e9a-bf1a6a14e830 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:24.065754 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-069f56c3-8273-4c8d-9e9a-bf1a6a14e830 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 776274a0-88c0-44b4-a063-82ee7044718d] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:24.075307 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-069f56c3-8273-4c8d-9e9a-bf1a6a14e830 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:24.075785 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-069f56c3-8273-4c8d-9e9a-bf1a6a14e830 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:24.076211 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-069f56c3-8273-4c8d-9e9a-bf1a6a14e830 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:24.076898 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-069f56c3-8273-4c8d-9e9a-bf1a6a14e830 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:24.077348 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-069f56c3-8273-4c8d-9e9a-bf1a6a14e830 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:24.077765 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-069f56c3-8273-4c8d-9e9a-bf1a6a14e830 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:24.179428 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-069f56c3-8273-4c8d-9e9a-bf1a6a14e830 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49947bfa2a5482d919ba0d4744553c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1b162d022d4c5ebd8c62dcad277727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:24.187453 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-069f56c3-8273-4c8d-9e9a-bf1a6a14e830 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "GET /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d" status: 200 len: 1278 microversion: 2.1 time: 0.129315 Oct 24 08:57:24.202744 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 465/938] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:24 2022] GET /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d => generated 1278 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:25.211476 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-8bea5f75-4b18-4c8f-b3be-78caa3bbfed4 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:25.212070 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-8bea5f75-4b18-4c8f-b3be-78caa3bbfed4 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 776274a0-88c0-44b4-a063-82ee7044718d] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:25.214501 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell1:SELECT=10 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:25.221694 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8bea5f75-4b18-4c8f-b3be-78caa3bbfed4 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:25.222167 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8bea5f75-4b18-4c8f-b3be-78caa3bbfed4 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:25.222601 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8bea5f75-4b18-4c8f-b3be-78caa3bbfed4 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:25.223352 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8bea5f75-4b18-4c8f-b3be-78caa3bbfed4 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:25.223804 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8bea5f75-4b18-4c8f-b3be-78caa3bbfed4 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:25.224230 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-8bea5f75-4b18-4c8f-b3be-78caa3bbfed4 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:25.402686 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-8bea5f75-4b18-4c8f-b3be-78caa3bbfed4 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49947bfa2a5482d919ba0d4744553c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1b162d022d4c5ebd8c62dcad277727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:25.410960 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-8bea5f75-4b18-4c8f-b3be-78caa3bbfed4 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "GET /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d" status: 200 len: 1318 microversion: 2.1 time: 0.203400 Oct 24 08:57:25.411525 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 474/939] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:25 2022] GET /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:25.528656 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-4c7bb56f-fe52-46c1-937b-07390493ebc3 req-6baa626c-c5e2-4e5c-be36-c3453e420be6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "776274a0-88c0-44b4-a063-82ee7044718d", "tag": "1e5d4e38-e3e8-4eff-ab9f-c653c33827b4"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:57:25.539319 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-4c7bb56f-fe52-46c1-937b-07390493ebc3 req-6baa626c-c5e2-4e5c-be36-c3453e420be6 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:25.540196 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-4c7bb56f-fe52-46c1-937b-07390493ebc3 req-6baa626c-c5e2-4e5c-be36-c3453e420be6 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:25.540826 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-4c7bb56f-fe52-46c1-937b-07390493ebc3 req-6baa626c-c5e2-4e5c-be36-c3453e420be6 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:25.552004 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-4c7bb56f-fe52-46c1-937b-07390493ebc3 req-6baa626c-c5e2-4e5c-be36-c3453e420be6 service nova] Creating event network-changed:1e5d4e38-e3e8-4eff-ab9f-c653c33827b4 for instance 776274a0-88c0-44b4-a063-82ee7044718d on hv-cinder-maste Oct 24 08:57:25.557210 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-4c7bb56f-fe52-46c1-937b-07390493ebc3 req-6baa626c-c5e2-4e5c-be36-c3453e420be6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032303 Oct 24 08:57:25.557947 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 466/940] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:57:26.438594 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-d94281df-5c61-4312-a4a6-9078566c5275 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:26.439623 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-d94281df-5c61-4312-a4a6-9078566c5275 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 776274a0-88c0-44b4-a063-82ee7044718d] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:26.447182 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d94281df-5c61-4312-a4a6-9078566c5275 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:26.447730 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d94281df-5c61-4312-a4a6-9078566c5275 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:26.448283 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d94281df-5c61-4312-a4a6-9078566c5275 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:26.449056 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d94281df-5c61-4312-a4a6-9078566c5275 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:26.449562 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d94281df-5c61-4312-a4a6-9078566c5275 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:26.450043 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-d94281df-5c61-4312-a4a6-9078566c5275 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:26.587303 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-d94281df-5c61-4312-a4a6-9078566c5275 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49947bfa2a5482d919ba0d4744553c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1b162d022d4c5ebd8c62dcad277727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:26.599377 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-d94281df-5c61-4312-a4a6-9078566c5275 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "GET /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d" status: 200 len: 1318 microversion: 2.1 time: 0.167086 Oct 24 08:57:26.600210 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 475/941] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:26 2022] GET /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:27.626785 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-928f55e4-8d27-45dd-a1a4-21b456a3b368 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:27.627855 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-928f55e4-8d27-45dd-a1a4-21b456a3b368 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 776274a0-88c0-44b4-a063-82ee7044718d] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:27.637785 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-928f55e4-8d27-45dd-a1a4-21b456a3b368 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:27.638539 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-928f55e4-8d27-45dd-a1a4-21b456a3b368 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:27.639240 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-928f55e4-8d27-45dd-a1a4-21b456a3b368 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:27.640291 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-928f55e4-8d27-45dd-a1a4-21b456a3b368 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:27.641001 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-928f55e4-8d27-45dd-a1a4-21b456a3b368 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:27.641641 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-928f55e4-8d27-45dd-a1a4-21b456a3b368 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:27.785648 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-928f55e4-8d27-45dd-a1a4-21b456a3b368 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49947bfa2a5482d919ba0d4744553c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1b162d022d4c5ebd8c62dcad277727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:27.794035 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-928f55e4-8d27-45dd-a1a4-21b456a3b368 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "GET /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d" status: 200 len: 1318 microversion: 2.1 time: 0.174628 Oct 24 08:57:27.794591 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 467/942] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:27 2022] GET /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:28.828489 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-112c04a6-94f1-4b1d-8823-0b71c3fc0652 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:28.829423 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-112c04a6-94f1-4b1d-8823-0b71c3fc0652 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 776274a0-88c0-44b4-a063-82ee7044718d] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:28.836889 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-112c04a6-94f1-4b1d-8823-0b71c3fc0652 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:28.837404 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-112c04a6-94f1-4b1d-8823-0b71c3fc0652 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:28.837862 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-112c04a6-94f1-4b1d-8823-0b71c3fc0652 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:28.838585 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-112c04a6-94f1-4b1d-8823-0b71c3fc0652 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:28.839091 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-112c04a6-94f1-4b1d-8823-0b71c3fc0652 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:28.839541 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-112c04a6-94f1-4b1d-8823-0b71c3fc0652 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:28.981167 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-112c04a6-94f1-4b1d-8823-0b71c3fc0652 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49947bfa2a5482d919ba0d4744553c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1b162d022d4c5ebd8c62dcad277727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:28.988952 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-112c04a6-94f1-4b1d-8823-0b71c3fc0652 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "GET /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d" status: 200 len: 1318 microversion: 2.1 time: 0.167078 Oct 24 08:57:28.989513 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 476/943] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:28 2022] GET /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:30.015601 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-f9a642e7-b174-4607-9372-aa1313bd1651 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:30.016610 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-f9a642e7-b174-4607-9372-aa1313bd1651 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 776274a0-88c0-44b4-a063-82ee7044718d] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:30.027586 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f9a642e7-b174-4607-9372-aa1313bd1651 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:30.028386 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f9a642e7-b174-4607-9372-aa1313bd1651 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:30.029123 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f9a642e7-b174-4607-9372-aa1313bd1651 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:30.030254 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f9a642e7-b174-4607-9372-aa1313bd1651 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:30.031062 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f9a642e7-b174-4607-9372-aa1313bd1651 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:30.031771 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f9a642e7-b174-4607-9372-aa1313bd1651 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:30.163962 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-f9a642e7-b174-4607-9372-aa1313bd1651 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49947bfa2a5482d919ba0d4744553c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1b162d022d4c5ebd8c62dcad277727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:30.171896 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-f9a642e7-b174-4607-9372-aa1313bd1651 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "GET /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d" status: 200 len: 1318 microversion: 2.1 time: 0.162877 Oct 24 08:57:30.172465 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 468/944] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:30 2022] GET /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:31.195921 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-92f73a3d-4d41-4630-a13d-f31261405009 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:31.197366 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-92f73a3d-4d41-4630-a13d-f31261405009 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 776274a0-88c0-44b4-a063-82ee7044718d] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:31.205489 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-92f73a3d-4d41-4630-a13d-f31261405009 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:31.205980 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-92f73a3d-4d41-4630-a13d-f31261405009 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:31.206422 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-92f73a3d-4d41-4630-a13d-f31261405009 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:31.207176 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-92f73a3d-4d41-4630-a13d-f31261405009 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:31.207632 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-92f73a3d-4d41-4630-a13d-f31261405009 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:31.208061 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-92f73a3d-4d41-4630-a13d-f31261405009 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:31.348291 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-92f73a3d-4d41-4630-a13d-f31261405009 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49947bfa2a5482d919ba0d4744553c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1b162d022d4c5ebd8c62dcad277727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:31.355949 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-92f73a3d-4d41-4630-a13d-f31261405009 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "GET /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d" status: 200 len: 1318 microversion: 2.1 time: 0.164679 Oct 24 08:57:31.356484 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 477/945] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:31 2022] GET /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:31.646796 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-335687a1-e1cc-4d00-9577-d62b8e8132b0 req-86a5998a-a921-4246-97de-dd80bb247f99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "776274a0-88c0-44b4-a063-82ee7044718d", "name": "network-vif-plugged", "status": "completed", "tag": "1e5d4e38-e3e8-4eff-ab9f-c653c33827b4"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:57:31.658427 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-335687a1-e1cc-4d00-9577-d62b8e8132b0 req-86a5998a-a921-4246-97de-dd80bb247f99 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:31.658936 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-335687a1-e1cc-4d00-9577-d62b8e8132b0 req-86a5998a-a921-4246-97de-dd80bb247f99 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:31.659363 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-335687a1-e1cc-4d00-9577-d62b8e8132b0 req-86a5998a-a921-4246-97de-dd80bb247f99 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:31.671101 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-335687a1-e1cc-4d00-9577-d62b8e8132b0 req-86a5998a-a921-4246-97de-dd80bb247f99 service nova] Creating event network-vif-plugged:1e5d4e38-e3e8-4eff-ab9f-c653c33827b4 for instance 776274a0-88c0-44b4-a063-82ee7044718d on hv-cinder-maste Oct 24 08:57:31.676525 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-335687a1-e1cc-4d00-9577-d62b8e8132b0 req-86a5998a-a921-4246-97de-dd80bb247f99 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033744 Oct 24 08:57:31.677125 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 469/946] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:57:32.383855 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-ebae8ac6-d6d4-4048-a46a-aee9af12219e tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:32.385296 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-ebae8ac6-d6d4-4048-a46a-aee9af12219e tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 776274a0-88c0-44b4-a063-82ee7044718d] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:32.397727 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ebae8ac6-d6d4-4048-a46a-aee9af12219e tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:32.398539 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ebae8ac6-d6d4-4048-a46a-aee9af12219e tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:32.399446 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ebae8ac6-d6d4-4048-a46a-aee9af12219e tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:32.400732 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ebae8ac6-d6d4-4048-a46a-aee9af12219e tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:32.401480 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ebae8ac6-d6d4-4048-a46a-aee9af12219e tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:32.402177 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-ebae8ac6-d6d4-4048-a46a-aee9af12219e tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:32.532886 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-ebae8ac6-d6d4-4048-a46a-aee9af12219e tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49947bfa2a5482d919ba0d4744553c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1b162d022d4c5ebd8c62dcad277727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:32.541063 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-ebae8ac6-d6d4-4048-a46a-aee9af12219e tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "GET /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d" status: 200 len: 1318 microversion: 2.1 time: 0.164089 Oct 24 08:57:32.541565 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 478/947] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:32 2022] GET /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:33.569493 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-5ae2b102-a2a1-42fd-8412-93e04ca14b92 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:33.570396 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-5ae2b102-a2a1-42fd-8412-93e04ca14b92 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 776274a0-88c0-44b4-a063-82ee7044718d] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:33.574194 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell0:SELECT=2 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:33.575309 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell0:SELECT=6 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:33.584748 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5ae2b102-a2a1-42fd-8412-93e04ca14b92 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:33.585288 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5ae2b102-a2a1-42fd-8412-93e04ca14b92 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:33.585740 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5ae2b102-a2a1-42fd-8412-93e04ca14b92 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:33.586443 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5ae2b102-a2a1-42fd-8412-93e04ca14b92 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:33.586927 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5ae2b102-a2a1-42fd-8412-93e04ca14b92 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:33.587353 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5ae2b102-a2a1-42fd-8412-93e04ca14b92 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:33.723281 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-5ae2b102-a2a1-42fd-8412-93e04ca14b92 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49947bfa2a5482d919ba0d4744553c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1b162d022d4c5ebd8c62dcad277727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:33.731298 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-5ae2b102-a2a1-42fd-8412-93e04ca14b92 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "GET /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d" status: 200 len: 1318 microversion: 2.1 time: 0.168994 Oct 24 08:57:33.731902 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 470/948] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:33 2022] GET /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:34.759173 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-9b9196ef-e873-4f37-a2cb-7e3a7e374be9 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:57:34.760227 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-9b9196ef-e873-4f37-a2cb-7e3a7e374be9 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 776274a0-88c0-44b4-a063-82ee7044718d] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:34.763214 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell0:SELECT=2 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:34.771238 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9b9196ef-e873-4f37-a2cb-7e3a7e374be9 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:34.771719 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9b9196ef-e873-4f37-a2cb-7e3a7e374be9 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:34.772169 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9b9196ef-e873-4f37-a2cb-7e3a7e374be9 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:34.772825 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9b9196ef-e873-4f37-a2cb-7e3a7e374be9 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:34.773297 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9b9196ef-e873-4f37-a2cb-7e3a7e374be9 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:34.773713 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9b9196ef-e873-4f37-a2cb-7e3a7e374be9 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:34.904984 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-9b9196ef-e873-4f37-a2cb-7e3a7e374be9 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49947bfa2a5482d919ba0d4744553c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1b162d022d4c5ebd8c62dcad277727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:57:34.912840 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-9b9196ef-e873-4f37-a2cb-7e3a7e374be9 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "GET /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d" status: 200 len: 1507 microversion: 2.1 time: 0.160269 Oct 24 08:57:34.913382 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 479/949] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:57:34 2022] GET /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:57:53.387833 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-78e9642f-e252-441f-8d55-22824451f241 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b9ebc35-e3e9-41a9-8054-70a1eef18f2c", "device": "/dev/sdb"}} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:57:53.390691 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-78e9642f-e252-441f-8d55-22824451f241 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 776274a0-88c0-44b4-a063-82ee7044718d] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:57:53.392682 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:53.393470 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:53.398513 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-78e9642f-e252-441f-8d55-22824451f241 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:53.399046 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-78e9642f-e252-441f-8d55-22824451f241 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:53.399488 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-78e9642f-e252-441f-8d55-22824451f241 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:53.400189 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-78e9642f-e252-441f-8d55-22824451f241 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:53.400648 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-78e9642f-e252-441f-8d55-22824451f241 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:53.401078 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-78e9642f-e252-441f-8d55-22824451f241 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:53.782179 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-78e9642f-e252-441f-8d55-22824451f241 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "POST /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.398349 Oct 24 08:57:53.783308 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 471/950] 10.222.0.26 () {60 vars in 1323 bytes} [Mon Oct 24 08:57:53 2022] POST /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d/os-volume_attachments => generated 194 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:57:56.624926 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_api:SELECT=19 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:56.625723 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell1:SELECT=36 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:56.680441 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-0817b9f8-b897-40d5-902e-1dc43399c97c req-53a015f4-2a79-4f4c-9fc5-beeb390d9a5b admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "1b9ebc35-e3e9-41a9-8054-70a1eef18f2c", "create_info": {"type": "qcow2", "new_file": "volume-1b9ebc35-e3e9-41a9-8054-70a1eef18f2c.00f7e541-080e-4edb-b52a-10d06f31543a.vhdx", "snapshot_id": "00f7e541-080e-4edb-b52a-10d06f31543a"}}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:57:56.688837 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [req-0817b9f8-b897-40d5-902e-1dc43399c97c req-53a015f4-2a79-4f4c-9fc5-beeb390d9a5b admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dfb1c4c1-9694-4501-9182-d459e78ba11f(cell1) {{(pid=125164) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 24 08:57:56.689294 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-0817b9f8-b897-40d5-902e-1dc43399c97c req-53a015f4-2a79-4f4c-9fc5-beeb390d9a5b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:56.689761 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-0817b9f8-b897-40d5-902e-1dc43399c97c req-53a015f4-2a79-4f4c-9fc5-beeb390d9a5b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:56.690182 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-0817b9f8-b897-40d5-902e-1dc43399c97c req-53a015f4-2a79-4f4c-9fc5-beeb390d9a5b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:56.725478 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-0817b9f8-b897-40d5-902e-1dc43399c97c req-53a015f4-2a79-4f4c-9fc5-beeb390d9a5b admin admin] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:57:56.725955 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-0817b9f8-b897-40d5-902e-1dc43399c97c req-53a015f4-2a79-4f4c-9fc5-beeb390d9a5b admin admin] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:57:56.726382 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-0817b9f8-b897-40d5-902e-1dc43399c97c req-53a015f4-2a79-4f4c-9fc5-beeb390d9a5b admin admin] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:57:56.749972 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-0817b9f8-b897-40d5-902e-1dc43399c97c req-53a015f4-2a79-4f4c-9fc5-beeb390d9a5b admin admin] 10.222.0.36 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.129676 Oct 24 08:57:56.750576 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 480/951] 10.222.0.36 () {64 vars in 1326 bytes} [Mon Oct 24 08:57:56 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:58:00.834235 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-bdeb344d-3db1-486a-9928-652b8b2ab090 req-ff7dfcc0-7261-43a9-af3c-08ff61aafbfe admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "1b9ebc35-e3e9-41a9-8054-70a1eef18f2c", "create_info": {"type": "qcow2", "new_file": "volume-1b9ebc35-e3e9-41a9-8054-70a1eef18f2c.92fbfd4e-3ed8-4344-8750-f43037a795fc.vhdx", "snapshot_id": "92fbfd4e-3ed8-4344-8750-f43037a795fc"}}} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:00.842782 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [req-bdeb344d-3db1-486a-9928-652b8b2ab090 req-ff7dfcc0-7261-43a9-af3c-08ff61aafbfe admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dfb1c4c1-9694-4501-9182-d459e78ba11f(cell1) {{(pid=125165) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 24 08:58:00.843235 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-bdeb344d-3db1-486a-9928-652b8b2ab090 req-ff7dfcc0-7261-43a9-af3c-08ff61aafbfe admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:00.843702 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-bdeb344d-3db1-486a-9928-652b8b2ab090 req-ff7dfcc0-7261-43a9-af3c-08ff61aafbfe admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:00.844120 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-bdeb344d-3db1-486a-9928-652b8b2ab090 req-ff7dfcc0-7261-43a9-af3c-08ff61aafbfe admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:00.883998 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-bdeb344d-3db1-486a-9928-652b8b2ab090 req-ff7dfcc0-7261-43a9-af3c-08ff61aafbfe admin admin] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:00.884469 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-bdeb344d-3db1-486a-9928-652b8b2ab090 req-ff7dfcc0-7261-43a9-af3c-08ff61aafbfe admin admin] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:00.884894 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-bdeb344d-3db1-486a-9928-652b8b2ab090 req-ff7dfcc0-7261-43a9-af3c-08ff61aafbfe admin admin] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:00.908180 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-bdeb344d-3db1-486a-9928-652b8b2ab090 req-ff7dfcc0-7261-43a9-af3c-08ff61aafbfe admin admin] 10.222.0.36 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.134021 Oct 24 08:58:00.909004 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 472/952] 10.222.0.36 () {64 vars in 1326 bytes} [Mon Oct 24 08:58:00 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:58:04.130396 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-9312f283-6cfe-40dc-b2f8-540e99a8497d req-d4946e9c-bf0e-456b-b9fb-93cd0cbe9b18 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "1b9ebc35-e3e9-41a9-8054-70a1eef18f2c", "create_info": {"type": "qcow2", "new_file": "volume-1b9ebc35-e3e9-41a9-8054-70a1eef18f2c.383b421d-af2e-4cc6-b7f0-02e6fd84e806.vhdx", "snapshot_id": "383b421d-af2e-4cc6-b7f0-02e6fd84e806"}}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:04.133703 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-9312f283-6cfe-40dc-b2f8-540e99a8497d req-d4946e9c-bf0e-456b-b9fb-93cd0cbe9b18 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:04.134188 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-9312f283-6cfe-40dc-b2f8-540e99a8497d req-d4946e9c-bf0e-456b-b9fb-93cd0cbe9b18 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:04.134623 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-9312f283-6cfe-40dc-b2f8-540e99a8497d req-d4946e9c-bf0e-456b-b9fb-93cd0cbe9b18 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:04.143949 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-9312f283-6cfe-40dc-b2f8-540e99a8497d req-d4946e9c-bf0e-456b-b9fb-93cd0cbe9b18 admin admin] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:04.144417 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-9312f283-6cfe-40dc-b2f8-540e99a8497d req-d4946e9c-bf0e-456b-b9fb-93cd0cbe9b18 admin admin] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:04.144952 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-9312f283-6cfe-40dc-b2f8-540e99a8497d req-d4946e9c-bf0e-456b-b9fb-93cd0cbe9b18 admin admin] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:04.158430 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-9312f283-6cfe-40dc-b2f8-540e99a8497d req-d4946e9c-bf0e-456b-b9fb-93cd0cbe9b18 admin admin] 10.222.0.36 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.081545 Oct 24 08:58:04.159065 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 481/953] 10.222.0.36 () {64 vars in 1326 bytes} [Mon Oct 24 08:58:04 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:58:07.220252 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-3bde491d-b21e-4e40-9854-acbc9c462387 req-210547a0-a515-4d95-a1b2-925b5b55425e admin admin] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:07.223494 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-3bde491d-b21e-4e40-9854-acbc9c462387 req-210547a0-a515-4d95-a1b2-925b5b55425e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:07.223906 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-3bde491d-b21e-4e40-9854-acbc9c462387 req-210547a0-a515-4d95-a1b2-925b5b55425e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:07.224335 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-3bde491d-b21e-4e40-9854-acbc9c462387 req-210547a0-a515-4d95-a1b2-925b5b55425e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:07.233282 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-3bde491d-b21e-4e40-9854-acbc9c462387 req-210547a0-a515-4d95-a1b2-925b5b55425e admin admin] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:07.233738 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-3bde491d-b21e-4e40-9854-acbc9c462387 req-210547a0-a515-4d95-a1b2-925b5b55425e admin admin] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:07.234156 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-3bde491d-b21e-4e40-9854-acbc9c462387 req-210547a0-a515-4d95-a1b2-925b5b55425e admin admin] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:07.247262 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-3bde491d-b21e-4e40-9854-acbc9c462387 req-210547a0-a515-4d95-a1b2-925b5b55425e admin admin] 10.222.0.36 "DELETE /compute/v2.1/os-assisted-volume-snapshots/00f7e541-080e-4edb-b52a-10d06f31543a?delete_info=%7B%22file_to_merge%22:%20%22volume-1b9ebc35-e3e9-41a9-8054-70a1eef18f2c.00f7e541-080e-4edb-b52a-10d06f31543a.vhdx%22,%20%22volume_id%22:%20%221b9ebc35-e3e9-41a9-8054-70a1eef18f2c%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.082929 Oct 24 08:58:07.247799 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 473/954] 10.222.0.36 () {62 vars in 1800 bytes} [Mon Oct 24 08:58:07 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/00f7e541-080e-4edb-b52a-10d06f31543a?delete_info=%7B%22file_to_merge%22:%20%22volume-1b9ebc35-e3e9-41a9-8054-70a1eef18f2c.00f7e541-080e-4edb-b52a-10d06f31543a.vhdx%22,%20%22volume_id%22:%20%221b9ebc35-e3e9-41a9-8054-70a1eef18f2c%22%7D => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 08:58:11.403000 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_api:SELECT=2 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:11.455227 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-18441c2b-1f34-4775-8834-52badf312ab5 req-9eeff1bc-e0eb-4f9b-9192-b3d49988b8f6 admin admin] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:11.458443 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-18441c2b-1f34-4775-8834-52badf312ab5 req-9eeff1bc-e0eb-4f9b-9192-b3d49988b8f6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:11.458978 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-18441c2b-1f34-4775-8834-52badf312ab5 req-9eeff1bc-e0eb-4f9b-9192-b3d49988b8f6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:11.459404 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-18441c2b-1f34-4775-8834-52badf312ab5 req-9eeff1bc-e0eb-4f9b-9192-b3d49988b8f6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:11.467927 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-18441c2b-1f34-4775-8834-52badf312ab5 req-9eeff1bc-e0eb-4f9b-9192-b3d49988b8f6 admin admin] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:11.468407 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-18441c2b-1f34-4775-8834-52badf312ab5 req-9eeff1bc-e0eb-4f9b-9192-b3d49988b8f6 admin admin] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:11.468825 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-18441c2b-1f34-4775-8834-52badf312ab5 req-9eeff1bc-e0eb-4f9b-9192-b3d49988b8f6 admin admin] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:11.482177 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-18441c2b-1f34-4775-8834-52badf312ab5 req-9eeff1bc-e0eb-4f9b-9192-b3d49988b8f6 admin admin] 10.222.0.36 "DELETE /compute/v2.1/os-assisted-volume-snapshots/383b421d-af2e-4cc6-b7f0-02e6fd84e806?delete_info=%7B%22file_to_merge%22:%20%22volume-1b9ebc35-e3e9-41a9-8054-70a1eef18f2c.383b421d-af2e-4cc6-b7f0-02e6fd84e806.vhdx%22,%20%22volume_id%22:%20%221b9ebc35-e3e9-41a9-8054-70a1eef18f2c%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.080477 Oct 24 08:58:11.482906 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 482/955] 10.222.0.36 () {62 vars in 1800 bytes} [Mon Oct 24 08:58:11 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/383b421d-af2e-4cc6-b7f0-02e6fd84e806?delete_info=%7B%22file_to_merge%22:%20%22volume-1b9ebc35-e3e9-41a9-8054-70a1eef18f2c.383b421d-af2e-4cc6-b7f0-02e6fd84e806.vhdx%22,%20%22volume_id%22:%20%221b9ebc35-e3e9-41a9-8054-70a1eef18f2c%22%7D => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:58:14.570863 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_api:SELECT=4 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:14.634695 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-54757437-d2dc-4351-aa07-45628967b6f0 req-a2b7cc21-1b36-4842-9e27-072fff8b107a admin admin] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:14.639612 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-54757437-d2dc-4351-aa07-45628967b6f0 req-a2b7cc21-1b36-4842-9e27-072fff8b107a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:14.640226 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-54757437-d2dc-4351-aa07-45628967b6f0 req-a2b7cc21-1b36-4842-9e27-072fff8b107a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:14.640843 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-54757437-d2dc-4351-aa07-45628967b6f0 req-a2b7cc21-1b36-4842-9e27-072fff8b107a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:14.652525 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-54757437-d2dc-4351-aa07-45628967b6f0 req-a2b7cc21-1b36-4842-9e27-072fff8b107a admin admin] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:14.652985 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-54757437-d2dc-4351-aa07-45628967b6f0 req-a2b7cc21-1b36-4842-9e27-072fff8b107a admin admin] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:14.653406 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-54757437-d2dc-4351-aa07-45628967b6f0 req-a2b7cc21-1b36-4842-9e27-072fff8b107a admin admin] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:14.666568 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-54757437-d2dc-4351-aa07-45628967b6f0 req-a2b7cc21-1b36-4842-9e27-072fff8b107a admin admin] 10.222.0.36 "DELETE /compute/v2.1/os-assisted-volume-snapshots/92fbfd4e-3ed8-4344-8750-f43037a795fc?delete_info=%7B%22file_to_merge%22:%20%22volume-1b9ebc35-e3e9-41a9-8054-70a1eef18f2c.92fbfd4e-3ed8-4344-8750-f43037a795fc.vhdx%22,%20%22volume_id%22:%20%221b9ebc35-e3e9-41a9-8054-70a1eef18f2c%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.096880 Oct 24 08:58:14.667336 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 474/956] 10.222.0.36 () {62 vars in 1800 bytes} [Mon Oct 24 08:58:14 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/92fbfd4e-3ed8-4344-8750-f43037a795fc?delete_info=%7B%22file_to_merge%22:%20%22volume-1b9ebc35-e3e9-41a9-8054-70a1eef18f2c.92fbfd4e-3ed8-4344-8750-f43037a795fc.vhdx%22,%20%22volume_id%22:%20%221b9ebc35-e3e9-41a9-8054-70a1eef18f2c%22%7D => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:58:17.608171 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-50936de3-e6c7-4171-9ad6-2c37cdf47e66 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:17.608720 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-50936de3-e6c7-4171-9ad6-2c37cdf47e66 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 776274a0-88c0-44b4-a063-82ee7044718d] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:17.617834 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-50936de3-e6c7-4171-9ad6-2c37cdf47e66 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:17.618443 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-50936de3-e6c7-4171-9ad6-2c37cdf47e66 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:17.619044 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-50936de3-e6c7-4171-9ad6-2c37cdf47e66 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:17.620031 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-50936de3-e6c7-4171-9ad6-2c37cdf47e66 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:17.620671 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-50936de3-e6c7-4171-9ad6-2c37cdf47e66 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:17.621229 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-50936de3-e6c7-4171-9ad6-2c37cdf47e66 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:17.761272 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.objects.instance [None req-50936de3-e6c7-4171-9ad6-2c37cdf47e66 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lazy-loading 'services' on Instance uuid 776274a0-88c0-44b4-a063-82ee7044718d {{(pid=125164) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:58:17.838246 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-50936de3-e6c7-4171-9ad6-2c37cdf47e66 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "DELETE /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d/os-volume_attachments/1b9ebc35-e3e9-41a9-8054-70a1eef18f2c" status: 202 len: 0 microversion: 2.1 time: 0.237369 Oct 24 08:58:17.838798 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 483/957] 10.222.0.26 () {58 vars in 1416 bytes} [Mon Oct 24 08:58:17 2022] DELETE /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d/os-volume_attachments/1b9ebc35-e3e9-41a9-8054-70a1eef18f2c => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:58:18.979409 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-63280220-3312-4b4c-923a-0eaa8e56bfdb tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:18.979955 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-63280220-3312-4b4c-923a-0eaa8e56bfdb tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 776274a0-88c0-44b4-a063-82ee7044718d] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:18.986201 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-63280220-3312-4b4c-923a-0eaa8e56bfdb tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:18.986677 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-63280220-3312-4b4c-923a-0eaa8e56bfdb tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:18.987129 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-63280220-3312-4b4c-923a-0eaa8e56bfdb tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:18.987806 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-63280220-3312-4b4c-923a-0eaa8e56bfdb tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:18.988250 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-63280220-3312-4b4c-923a-0eaa8e56bfdb tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:18.988661 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-63280220-3312-4b4c-923a-0eaa8e56bfdb tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:19.013286 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-63280220-3312-4b4c-923a-0eaa8e56bfdb tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 776274a0-88c0-44b4-a063-82ee7044718d] Going to try to terminate instance {{(pid=125165) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:58:19.088925 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-63280220-3312-4b4c-923a-0eaa8e56bfdb tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "DELETE /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d" status: 204 len: 0 microversion: 2.1 time: 0.113901 Oct 24 08:58:19.089508 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 475/958] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Oct 24 08:58:18 2022] DELETE /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:58:19.098953 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-c5fc5dfe-9a93-404b-8a91-9d416b966cab tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:19.099557 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-c5fc5dfe-9a93-404b-8a91-9d416b966cab tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 776274a0-88c0-44b4-a063-82ee7044718d] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:19.106203 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c5fc5dfe-9a93-404b-8a91-9d416b966cab tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:19.106673 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c5fc5dfe-9a93-404b-8a91-9d416b966cab tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:19.107216 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c5fc5dfe-9a93-404b-8a91-9d416b966cab tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:19.107893 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c5fc5dfe-9a93-404b-8a91-9d416b966cab tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:19.108335 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c5fc5dfe-9a93-404b-8a91-9d416b966cab tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:19.108750 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-c5fc5dfe-9a93-404b-8a91-9d416b966cab tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:19.241359 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-c5fc5dfe-9a93-404b-8a91-9d416b966cab tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49947bfa2a5482d919ba0d4744553c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1b162d022d4c5ebd8c62dcad277727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:19.249589 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-c5fc5dfe-9a93-404b-8a91-9d416b966cab tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "GET /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d" status: 200 len: 1513 microversion: 2.1 time: 0.155016 Oct 24 08:58:19.250162 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 484/959] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:19 2022] GET /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:20.273599 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-5351264c-8e3f-4430-87c2-2caddf98f923 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:20.274317 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-5351264c-8e3f-4430-87c2-2caddf98f923 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 776274a0-88c0-44b4-a063-82ee7044718d] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:20.281175 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5351264c-8e3f-4430-87c2-2caddf98f923 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:20.281667 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5351264c-8e3f-4430-87c2-2caddf98f923 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:20.282104 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5351264c-8e3f-4430-87c2-2caddf98f923 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:20.282830 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5351264c-8e3f-4430-87c2-2caddf98f923 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:20.283387 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5351264c-8e3f-4430-87c2-2caddf98f923 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:20.283815 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-5351264c-8e3f-4430-87c2-2caddf98f923 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:20.413631 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-5351264c-8e3f-4430-87c2-2caddf98f923 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49947bfa2a5482d919ba0d4744553c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1b162d022d4c5ebd8c62dcad277727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:20.422380 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-5351264c-8e3f-4430-87c2-2caddf98f923 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "GET /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d" status: 200 len: 1513 microversion: 2.1 time: 0.153233 Oct 24 08:58:20.422959 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 476/960] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:20 2022] GET /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:21.453295 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-3e996eec-bc23-4d5c-8431-c3324cde2da7 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:21.454119 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-3e996eec-bc23-4d5c-8431-c3324cde2da7 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 776274a0-88c0-44b4-a063-82ee7044718d] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:21.463350 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3e996eec-bc23-4d5c-8431-c3324cde2da7 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:21.464025 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3e996eec-bc23-4d5c-8431-c3324cde2da7 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:21.464600 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3e996eec-bc23-4d5c-8431-c3324cde2da7 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:21.465511 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3e996eec-bc23-4d5c-8431-c3324cde2da7 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:21.466106 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3e996eec-bc23-4d5c-8431-c3324cde2da7 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:21.466660 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3e996eec-bc23-4d5c-8431-c3324cde2da7 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:21.467419 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell0:SELECT=6 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:21.602501 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-3e996eec-bc23-4d5c-8431-c3324cde2da7 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49947bfa2a5482d919ba0d4744553c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1b162d022d4c5ebd8c62dcad277727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:21.611252 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-3e996eec-bc23-4d5c-8431-c3324cde2da7 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "GET /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d" status: 200 len: 1513 microversion: 2.1 time: 0.164089 Oct 24 08:58:21.611796 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 485/961] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:21 2022] GET /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:22.638495 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-e28daa62-0a71-4b18-99e5-244fc8f6d3ed tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:22.639460 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-e28daa62-0a71-4b18-99e5-244fc8f6d3ed tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 776274a0-88c0-44b4-a063-82ee7044718d] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:22.651415 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e28daa62-0a71-4b18-99e5-244fc8f6d3ed tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:22.652760 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e28daa62-0a71-4b18-99e5-244fc8f6d3ed tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:22.654227 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e28daa62-0a71-4b18-99e5-244fc8f6d3ed tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:22.655486 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e28daa62-0a71-4b18-99e5-244fc8f6d3ed tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:22.656295 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e28daa62-0a71-4b18-99e5-244fc8f6d3ed tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:22.657028 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-e28daa62-0a71-4b18-99e5-244fc8f6d3ed tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:22.803338 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-e28daa62-0a71-4b18-99e5-244fc8f6d3ed tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49947bfa2a5482d919ba0d4744553c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1b162d022d4c5ebd8c62dcad277727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:22.812003 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-e28daa62-0a71-4b18-99e5-244fc8f6d3ed tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "GET /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d" status: 200 len: 1513 microversion: 2.1 time: 0.179820 Oct 24 08:58:22.812571 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 477/962] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:22 2022] GET /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d => generated 1513 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:23.839317 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-68d3c956-14d3-4e4e-aab0-1bdfe6e3a322 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:23.840385 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-68d3c956-14d3-4e4e-aab0-1bdfe6e3a322 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 776274a0-88c0-44b4-a063-82ee7044718d] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:23.852743 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-68d3c956-14d3-4e4e-aab0-1bdfe6e3a322 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:23.853549 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-68d3c956-14d3-4e4e-aab0-1bdfe6e3a322 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:23.854276 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-68d3c956-14d3-4e4e-aab0-1bdfe6e3a322 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:23.855479 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-68d3c956-14d3-4e4e-aab0-1bdfe6e3a322 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:23.856234 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-68d3c956-14d3-4e4e-aab0-1bdfe6e3a322 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:23.856940 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-68d3c956-14d3-4e4e-aab0-1bdfe6e3a322 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:24.023545 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-68d3c956-14d3-4e4e-aab0-1bdfe6e3a322 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49947bfa2a5482d919ba0d4744553c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1b162d022d4c5ebd8c62dcad277727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:24.032371 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-68d3c956-14d3-4e4e-aab0-1bdfe6e3a322 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "GET /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d" status: 200 len: 1513 microversion: 2.1 time: 0.199622 Oct 24 08:58:24.033156 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 486/963] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:23 2022] GET /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d => generated 1513 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:24.513111 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-8e62c470-1416-48bb-bc55-eb3eefcfbf99 req-26fd7490-2b8c-42b4-b0d9-5ccb6c7f9ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "776274a0-88c0-44b4-a063-82ee7044718d", "name": "network-vif-deleted", "tag": "1e5d4e38-e3e8-4eff-ab9f-c653c33827b4"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:24.522825 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-8e62c470-1416-48bb-bc55-eb3eefcfbf99 req-26fd7490-2b8c-42b4-b0d9-5ccb6c7f9ee8 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:24.523304 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-8e62c470-1416-48bb-bc55-eb3eefcfbf99 req-26fd7490-2b8c-42b4-b0d9-5ccb6c7f9ee8 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:24.524103 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-8e62c470-1416-48bb-bc55-eb3eefcfbf99 req-26fd7490-2b8c-42b4-b0d9-5ccb6c7f9ee8 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:24.527671 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:24.536338 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-8e62c470-1416-48bb-bc55-eb3eefcfbf99 req-26fd7490-2b8c-42b4-b0d9-5ccb6c7f9ee8 service nova] Creating event network-vif-deleted:1e5d4e38-e3e8-4eff-ab9f-c653c33827b4 for instance 776274a0-88c0-44b4-a063-82ee7044718d on hv-cinder-maste Oct 24 08:58:24.541698 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-8e62c470-1416-48bb-bc55-eb3eefcfbf99 req-26fd7490-2b8c-42b4-b0d9-5ccb6c7f9ee8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088079 Oct 24 08:58:24.542291 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 478/964] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:58:25.055985 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-0c27dfa3-f919-4339-b214-ae00051fcaa4 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:25.056597 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-0c27dfa3-f919-4339-b214-ae00051fcaa4 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 776274a0-88c0-44b4-a063-82ee7044718d] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:25.063579 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0c27dfa3-f919-4339-b214-ae00051fcaa4 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:25.064076 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0c27dfa3-f919-4339-b214-ae00051fcaa4 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:25.064542 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0c27dfa3-f919-4339-b214-ae00051fcaa4 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:25.065245 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0c27dfa3-f919-4339-b214-ae00051fcaa4 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:25.065720 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0c27dfa3-f919-4339-b214-ae00051fcaa4 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:25.066146 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0c27dfa3-f919-4339-b214-ae00051fcaa4 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:25.103797 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0c27dfa3-f919-4339-b214-ae00051fcaa4 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:25.104286 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0c27dfa3-f919-4339-b214-ae00051fcaa4 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:25.104718 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-0c27dfa3-f919-4339-b214-ae00051fcaa4 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:25.105166 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.objects.instance [None req-0c27dfa3-f919-4339-b214-ae00051fcaa4 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lazy-loading 'fault' on Instance uuid 776274a0-88c0-44b4-a063-82ee7044718d {{(pid=125164) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:58:25.146559 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-0c27dfa3-f919-4339-b214-ae00051fcaa4 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49947bfa2a5482d919ba0d4744553c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1b162d022d4c5ebd8c62dcad277727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:25.153712 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-0c27dfa3-f919-4339-b214-ae00051fcaa4 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "GET /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d" status: 200 len: 1308 microversion: 2.1 time: 0.101612 Oct 24 08:58:25.154311 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 487/965] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:25 2022] GET /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:26.177325 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell0:SELECT=6 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:26.185451 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-d96101cf-d21d-4b4a-a830-caf8e8fcb241 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:26.186597 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-d96101cf-d21d-4b4a-a830-caf8e8fcb241 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 776274a0-88c0-44b4-a063-82ee7044718d] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:26.197952 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d96101cf-d21d-4b4a-a830-caf8e8fcb241 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:26.198778 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d96101cf-d21d-4b4a-a830-caf8e8fcb241 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:26.199518 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d96101cf-d21d-4b4a-a830-caf8e8fcb241 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:26.200639 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d96101cf-d21d-4b4a-a830-caf8e8fcb241 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:26.201329 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d96101cf-d21d-4b4a-a830-caf8e8fcb241 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:26.201751 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d96101cf-d21d-4b4a-a830-caf8e8fcb241 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:26.217687 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.wsgi [None req-d96101cf-d21d-4b4a-a830-caf8e8fcb241 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] HTTP exception thrown: Instance 776274a0-88c0-44b4-a063-82ee7044718d could not be found. Oct 24 08:58:26.219319 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-d96101cf-d21d-4b4a-a830-caf8e8fcb241 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Request method failure captured: Oct 24 08:58:26.219319 dv-cinder-master-3-smb devstack@n-api.service[125165]: request: GET /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d HTTP/1.1 Oct 24 08:58:26.219319 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept: application/json Oct 24 08:58:26.219319 dv-cinder-master-3-smb devstack@n-api.service[125165]: Accept-Encoding: identity Oct 24 08:58:26.219319 dv-cinder-master-3-smb devstack@n-api.service[125165]: Connection: close Oct 24 08:58:26.219319 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Length: 0 Oct 24 08:58:26.219319 dv-cinder-master-3-smb devstack@n-api.service[125165]: Content-Type: application/json Oct 24 08:58:26.219319 dv-cinder-master-3-smb devstack@n-api.service[125165]: Host: 10.222.0.26 Oct 24 08:58:26.219319 dv-cinder-master-3-smb devstack@n-api.service[125165]: Openstack-System-Scope: None Oct 24 08:58:26.219319 dv-cinder-master-3-smb devstack@n-api.service[125165]: User-Agent: python-urllib3/1.26.12 Oct 24 08:58:26.219319 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Auth-Token: gAAAAABjVlNwMIPXw2xRjVN_esL7qXUuo9UNFfng4IMopL_kqqWS-uFu8PxfKWurzfG7R5RSk396zjIxxcTvWEvKnakCvg5rNJI0UdwJk_XxUIGNbuFG1fNegl1TjChe_OZQsnlcCuNm076ktfwptPDC75dPyQxR9ZPlywvk18Q1ABZ3dj3V5SU Oct 24 08:58:26.219319 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Id: None Oct 24 08:58:26.219319 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Domain-Name: None Oct 24 08:58:26.219319 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Identity-Status: Confirmed Oct 24 08:58:26.219319 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Is-Admin-Project: True Oct 24 08:58:26.219319 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Id: default Oct 24 08:58:26.219319 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Domain-Name: Default Oct 24 08:58:26.219319 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Id: 0b1b162d022d4c5ebd8c62dcad277727 Oct 24 08:58:26.219319 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Project-Name: tempest-VolumesSnapshotTestJSON-157810618 Oct 24 08:58:26.219319 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Role: reader,member Oct 24 08:58:26.219319 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Roles: reader,member Oct 24 08:58:26.221243 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b1b162d022d4c5ebd8c62dcad277727", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b1b162d022d4c5ebd8c62dcad277727"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b1b162d022d4c5ebd8c62dcad277727"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b1b162d022d4c5ebd8c62dcad277727"}]}] Oct 24 08:58:26.221243 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant: tempest-VolumesSnapshotTestJSON-157810618 Oct 24 08:58:26.221243 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Id: 0b1b162d022d4c5ebd8c62dcad277727 Oct 24 08:58:26.221243 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-157810618 Oct 24 08:58:26.221243 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User: tempest-VolumesSnapshotTestJSON-157810618-project Oct 24 08:58:26.221243 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Id: default Oct 24 08:58:26.221243 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Domain-Name: Default Oct 24 08:58:26.221243 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Id: a49947bfa2a5482d919ba0d4744553c7 Oct 24 08:58:26.221243 dv-cinder-master-3-smb devstack@n-api.service[125165]: X-User-Name: tempest-VolumesSnapshotTestJSON-157810618-project Oct 24 08:58:26.221243 dv-cinder-master-3-smb devstack@n-api.service[125165]: method: > Oct 24 08:58:26.221243 dv-cinder-master-3-smb devstack@n-api.service[125165]: exception: Instance 776274a0-88c0-44b4-a063-82ee7044718d could not be found. Oct 24 08:58:26.221243 dv-cinder-master-3-smb devstack@n-api.service[125165]: action_args: {'id': '776274a0-88c0-44b4-a063-82ee7044718d'} Oct 24 08:58:26.222177 dv-cinder-master-3-smb devstack@n-api.service[125165]: {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:58:26.222177 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:58:26.222177 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:58:26.222177 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:58:26.222177 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:58:26.222177 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:58:26.222177 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:58:26.222177 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:58:26.222177 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:58:26.222177 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:58:26.222177 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 776274a0-88c0-44b4-a063-82ee7044718d could not be found. Oct 24 08:58:26.222177 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:58:26.222177 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:58:26.222177 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:58:26.222177 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:58:26.222177 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:58:26.222177 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:58:26.222177 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:58:26.222177 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:58:26.222177 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:58:26.223756 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:58:26.223756 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:58:26.223756 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:58:26.223756 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:58:26.223756 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:58:26.223756 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:58:26.223756 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:58:26.223756 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 776274a0-88c0-44b4-a063-82ee7044718d could not be found. Oct 24 08:58:26.223756 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:58:26.223756 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:58:26.223756 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:58:26.223756 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:58:26.223756 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:58:26.223756 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:58:26.223756 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:58:26.223756 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:58:26.223756 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 776274a0-88c0-44b4-a063-82ee7044718d could not be found. Oct 24 08:58:26.223756 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR nova.api.openstack.wsgi Oct 24 08:58:26.224966 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-d96101cf-d21d-4b4a-a830-caf8e8fcb241 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Returning 404 to user: Instance 776274a0-88c0-44b4-a063-82ee7044718d could not be found. {{(pid=125165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:58:26.224966 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-d96101cf-d21d-4b4a-a830-caf8e8fcb241 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "GET /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d" status: 404 len: 111 microversion: 2.1 time: 0.045738 Oct 24 08:58:26.224966 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 479/966] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:26 2022] GET /compute/v2.1/servers/776274a0-88c0-44b4-a063-82ee7044718d => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 08:58:29.946637 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-1fd9b962-7c93-463f-9ff2-3cbdb70ada2f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1167089066", "imageRef": "7eef2d62-12dc-4746-9cbd-870797d39b4d", "flavorRef": "452", "networks": [{"uuid": "ac41dbd8-bda4-4bbc-b503-ed53ba1b0720"}]}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:30.005240 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.network.neutron [None req-1fd9b962-7c93-463f-9ff2-3cbdb70ada2f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] validate_networks() for [('ac41dbd8-bda4-4bbc-b503-ed53ba1b0720', None, None, None, None, None)] {{(pid=125164) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 08:58:30.372331 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-1fd9b962-7c93-463f-9ff2-3cbdb70ada2f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Flavor limits 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 08:58:30.372743 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-1fd9b962-7c93-463f-9ff2-3cbdb70ada2f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Image limits 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 08:58:30.373210 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-1fd9b962-7c93-463f-9ff2-3cbdb70ada2f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Flavor pref 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 08:58:30.373606 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-1fd9b962-7c93-463f-9ff2-3cbdb70ada2f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Image pref 0:0:0 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 08:58:30.374010 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.virt.hardware [None req-1fd9b962-7c93-463f-9ff2-3cbdb70ada2f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125164) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 08:58:30.383680 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1fd9b962-7c93-463f-9ff2-3cbdb70ada2f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:30.384171 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1fd9b962-7c93-463f-9ff2-3cbdb70ada2f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:30.384643 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1fd9b962-7c93-463f-9ff2-3cbdb70ada2f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:30.385362 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1fd9b962-7c93-463f-9ff2-3cbdb70ada2f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:30.385875 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1fd9b962-7c93-463f-9ff2-3cbdb70ada2f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:30.386292 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1fd9b962-7c93-463f-9ff2-3cbdb70ada2f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:30.391840 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell1:SELECT=42,nova_cell1:INSERT=1 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:30.404802 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.quota [None req-1fd9b962-7c93-463f-9ff2-3cbdb70ada2f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Getting quotas for project 0b1b162d022d4c5ebd8c62dcad277727. Resources: {'ram', 'cores', 'instances'} {{(pid=125164) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 08:58:30.408951 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.quota [None req-1fd9b962-7c93-463f-9ff2-3cbdb70ada2f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Getting quotas for user a49947bfa2a5482d919ba0d4744553c7 and project 0b1b162d022d4c5ebd8c62dcad277727. Resources: {'ram', 'cores', 'instances'} {{(pid=125164) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 08:58:30.419977 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-1fd9b962-7c93-463f-9ff2-3cbdb70ada2f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Going to run 1 instances... {{(pid=125164) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 08:58:30.422271 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-1fd9b962-7c93-463f-9ff2-3cbdb70ada2f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 795782c5-dd36-4185-b9cb-46377ec81275] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7eef2d62-12dc-4746-9cbd-870797d39b4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125164) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 08:58:30.472040 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-1fd9b962-7c93-463f-9ff2-3cbdb70ada2f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529267 Oct 24 08:58:30.472723 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 488/967] 10.222.0.26 () {60 vars in 1147 bytes} [Mon Oct 24 08:58:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 08:58:30.484461 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-b6169802-3cb5-444e-b03e-e4db38e4fc6b tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:30.485091 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-b6169802-3cb5-444e-b03e-e4db38e4fc6b tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 795782c5-dd36-4185-b9cb-46377ec81275] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:30.544150 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-b6169802-3cb5-444e-b03e-e4db38e4fc6b tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49947bfa2a5482d919ba0d4744553c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1b162d022d4c5ebd8c62dcad277727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:30.552110 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-b6169802-3cb5-444e-b03e-e4db38e4fc6b tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "GET /compute/v2.1/servers/795782c5-dd36-4185-b9cb-46377ec81275" status: 200 len: 1219 microversion: 2.1 time: 0.071720 Oct 24 08:58:30.553037 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 480/968] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:30 2022] GET /compute/v2.1/servers/795782c5-dd36-4185-b9cb-46377ec81275 => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:31.579879 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-76889830-d1a7-42b5-9a82-d08201d83749 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:31.581001 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-76889830-d1a7-42b5-9a82-d08201d83749 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 795782c5-dd36-4185-b9cb-46377ec81275] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:31.592541 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-76889830-d1a7-42b5-9a82-d08201d83749 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:31.593039 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-76889830-d1a7-42b5-9a82-d08201d83749 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:31.593478 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-76889830-d1a7-42b5-9a82-d08201d83749 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:31.594171 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-76889830-d1a7-42b5-9a82-d08201d83749 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:31.594629 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-76889830-d1a7-42b5-9a82-d08201d83749 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:31.595073 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-76889830-d1a7-42b5-9a82-d08201d83749 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:31.656871 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-76889830-d1a7-42b5-9a82-d08201d83749 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49947bfa2a5482d919ba0d4744553c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1b162d022d4c5ebd8c62dcad277727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:31.664624 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-76889830-d1a7-42b5-9a82-d08201d83749 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "GET /compute/v2.1/servers/795782c5-dd36-4185-b9cb-46377ec81275" status: 200 len: 1271 microversion: 2.1 time: 0.092250 Oct 24 08:58:31.665227 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 489/969] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:31 2022] GET /compute/v2.1/servers/795782c5-dd36-4185-b9cb-46377ec81275 => generated 1271 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:32.690986 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-4112d84a-1a3e-47a5-8bae-6b7da82ae690 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:32.691717 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-4112d84a-1a3e-47a5-8bae-6b7da82ae690 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 795782c5-dd36-4185-b9cb-46377ec81275] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:32.855985 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4112d84a-1a3e-47a5-8bae-6b7da82ae690 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:32.856485 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4112d84a-1a3e-47a5-8bae-6b7da82ae690 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:32.856927 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4112d84a-1a3e-47a5-8bae-6b7da82ae690 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:32.857636 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4112d84a-1a3e-47a5-8bae-6b7da82ae690 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:32.858180 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4112d84a-1a3e-47a5-8bae-6b7da82ae690 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:32.858605 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-4112d84a-1a3e-47a5-8bae-6b7da82ae690 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:33.075384 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-4112d84a-1a3e-47a5-8bae-6b7da82ae690 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49947bfa2a5482d919ba0d4744553c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1b162d022d4c5ebd8c62dcad277727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:33.083389 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-4112d84a-1a3e-47a5-8bae-6b7da82ae690 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "GET /compute/v2.1/servers/795782c5-dd36-4185-b9cb-46377ec81275" status: 200 len: 1319 microversion: 2.1 time: 0.396327 Oct 24 08:58:33.083951 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 481/970] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:32 2022] GET /compute/v2.1/servers/795782c5-dd36-4185-b9cb-46377ec81275 => generated 1319 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:33.219550 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-37c14bab-3b6c-48dd-b108-792540e7543d req-4e80832c-e7ca-447a-b77a-db648acd45b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "795782c5-dd36-4185-b9cb-46377ec81275", "tag": "d24bc1d0-a568-4363-8513-9b81dbdec060"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:33.229771 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-37c14bab-3b6c-48dd-b108-792540e7543d req-4e80832c-e7ca-447a-b77a-db648acd45b0 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:33.230212 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-37c14bab-3b6c-48dd-b108-792540e7543d req-4e80832c-e7ca-447a-b77a-db648acd45b0 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:33.230671 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-37c14bab-3b6c-48dd-b108-792540e7543d req-4e80832c-e7ca-447a-b77a-db648acd45b0 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:33.243902 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-37c14bab-3b6c-48dd-b108-792540e7543d req-4e80832c-e7ca-447a-b77a-db648acd45b0 service nova] Creating event network-changed:d24bc1d0-a568-4363-8513-9b81dbdec060 for instance 795782c5-dd36-4185-b9cb-46377ec81275 on hv-cinder-maste Oct 24 08:58:33.249048 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-37c14bab-3b6c-48dd-b108-792540e7543d req-4e80832c-e7ca-447a-b77a-db648acd45b0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033353 Oct 24 08:58:33.249619 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 490/971] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 08:58:34.111071 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-d4ff40f4-6e1f-4d53-ad33-3f19564fa11b tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:34.111637 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-d4ff40f4-6e1f-4d53-ad33-3f19564fa11b tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 795782c5-dd36-4185-b9cb-46377ec81275] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:34.118832 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d4ff40f4-6e1f-4d53-ad33-3f19564fa11b tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:34.119339 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d4ff40f4-6e1f-4d53-ad33-3f19564fa11b tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:34.119764 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d4ff40f4-6e1f-4d53-ad33-3f19564fa11b tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:34.120579 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d4ff40f4-6e1f-4d53-ad33-3f19564fa11b tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:34.121027 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d4ff40f4-6e1f-4d53-ad33-3f19564fa11b tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:34.121444 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d4ff40f4-6e1f-4d53-ad33-3f19564fa11b tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:34.263490 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-d4ff40f4-6e1f-4d53-ad33-3f19564fa11b tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49947bfa2a5482d919ba0d4744553c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1b162d022d4c5ebd8c62dcad277727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:34.271336 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-d4ff40f4-6e1f-4d53-ad33-3f19564fa11b tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "GET /compute/v2.1/servers/795782c5-dd36-4185-b9cb-46377ec81275" status: 200 len: 1319 microversion: 2.1 time: 0.165474 Oct 24 08:58:34.271886 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 482/972] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:34 2022] GET /compute/v2.1/servers/795782c5-dd36-4185-b9cb-46377ec81275 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:35.301777 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-41ca689e-8180-4119-8826-82babaf59f1f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:35.302638 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-41ca689e-8180-4119-8826-82babaf59f1f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 795782c5-dd36-4185-b9cb-46377ec81275] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:35.310307 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-41ca689e-8180-4119-8826-82babaf59f1f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:35.310936 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-41ca689e-8180-4119-8826-82babaf59f1f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:35.311495 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-41ca689e-8180-4119-8826-82babaf59f1f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:35.312181 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-41ca689e-8180-4119-8826-82babaf59f1f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:35.312646 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-41ca689e-8180-4119-8826-82babaf59f1f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:35.313065 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-41ca689e-8180-4119-8826-82babaf59f1f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:35.465672 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-41ca689e-8180-4119-8826-82babaf59f1f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49947bfa2a5482d919ba0d4744553c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1b162d022d4c5ebd8c62dcad277727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:35.474476 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-41ca689e-8180-4119-8826-82babaf59f1f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "GET /compute/v2.1/servers/795782c5-dd36-4185-b9cb-46377ec81275" status: 200 len: 1319 microversion: 2.1 time: 0.178621 Oct 24 08:58:35.475070 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 491/973] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:35 2022] GET /compute/v2.1/servers/795782c5-dd36-4185-b9cb-46377ec81275 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:36.497082 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-346c58b8-5c09-41aa-b1f5-c700d4f3c19a tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:36.497693 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-346c58b8-5c09-41aa-b1f5-c700d4f3c19a tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 795782c5-dd36-4185-b9cb-46377ec81275] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:36.504492 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-346c58b8-5c09-41aa-b1f5-c700d4f3c19a tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:36.504979 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-346c58b8-5c09-41aa-b1f5-c700d4f3c19a tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:36.505414 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-346c58b8-5c09-41aa-b1f5-c700d4f3c19a tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:36.506078 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-346c58b8-5c09-41aa-b1f5-c700d4f3c19a tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:36.506527 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-346c58b8-5c09-41aa-b1f5-c700d4f3c19a tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:36.506981 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-346c58b8-5c09-41aa-b1f5-c700d4f3c19a tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:36.648041 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-346c58b8-5c09-41aa-b1f5-c700d4f3c19a tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49947bfa2a5482d919ba0d4744553c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1b162d022d4c5ebd8c62dcad277727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:36.659266 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-346c58b8-5c09-41aa-b1f5-c700d4f3c19a tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "GET /compute/v2.1/servers/795782c5-dd36-4185-b9cb-46377ec81275" status: 200 len: 1319 microversion: 2.1 time: 0.166153 Oct 24 08:58:36.659984 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 483/974] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:36 2022] GET /compute/v2.1/servers/795782c5-dd36-4185-b9cb-46377ec81275 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:37.688606 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-3a4c96ee-8b42-4bfc-a928-049208bf42bf tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:37.689266 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-3a4c96ee-8b42-4bfc-a928-049208bf42bf tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 795782c5-dd36-4185-b9cb-46377ec81275] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:37.695873 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3a4c96ee-8b42-4bfc-a928-049208bf42bf tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:37.696387 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3a4c96ee-8b42-4bfc-a928-049208bf42bf tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:37.696850 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3a4c96ee-8b42-4bfc-a928-049208bf42bf tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:37.697586 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3a4c96ee-8b42-4bfc-a928-049208bf42bf tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:37.698063 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3a4c96ee-8b42-4bfc-a928-049208bf42bf tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:37.698514 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3a4c96ee-8b42-4bfc-a928-049208bf42bf tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:37.836350 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-3a4c96ee-8b42-4bfc-a928-049208bf42bf tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49947bfa2a5482d919ba0d4744553c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1b162d022d4c5ebd8c62dcad277727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:37.844436 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-3a4c96ee-8b42-4bfc-a928-049208bf42bf tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "GET /compute/v2.1/servers/795782c5-dd36-4185-b9cb-46377ec81275" status: 200 len: 1319 microversion: 2.1 time: 0.161583 Oct 24 08:58:37.845014 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 492/975] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:37 2022] GET /compute/v2.1/servers/795782c5-dd36-4185-b9cb-46377ec81275 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:37.943229 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-359ef3f9-aac2-4958-b6f6-c5d6306eed6c req-8b89d79f-7c55-4069-a48b-edae10f2cf09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "795782c5-dd36-4185-b9cb-46377ec81275", "name": "network-vif-plugged", "status": "completed", "tag": "d24bc1d0-a568-4363-8513-9b81dbdec060"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:37.955996 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-359ef3f9-aac2-4958-b6f6-c5d6306eed6c req-8b89d79f-7c55-4069-a48b-edae10f2cf09 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:37.956485 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-359ef3f9-aac2-4958-b6f6-c5d6306eed6c req-8b89d79f-7c55-4069-a48b-edae10f2cf09 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:37.956992 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-359ef3f9-aac2-4958-b6f6-c5d6306eed6c req-8b89d79f-7c55-4069-a48b-edae10f2cf09 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:37.967949 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-359ef3f9-aac2-4958-b6f6-c5d6306eed6c req-8b89d79f-7c55-4069-a48b-edae10f2cf09 service nova] Creating event network-vif-plugged:d24bc1d0-a568-4363-8513-9b81dbdec060 for instance 795782c5-dd36-4185-b9cb-46377ec81275 on hv-cinder-maste Oct 24 08:58:37.972980 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-359ef3f9-aac2-4958-b6f6-c5d6306eed6c req-8b89d79f-7c55-4069-a48b-edae10f2cf09 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033556 Oct 24 08:58:37.973582 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 484/976] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:58:38.867649 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-9c928fc3-4362-48cd-bd93-441ba7aa64ac tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:38.868373 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-9c928fc3-4362-48cd-bd93-441ba7aa64ac tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 795782c5-dd36-4185-b9cb-46377ec81275] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:38.875193 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9c928fc3-4362-48cd-bd93-441ba7aa64ac tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:38.875687 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9c928fc3-4362-48cd-bd93-441ba7aa64ac tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:38.876178 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9c928fc3-4362-48cd-bd93-441ba7aa64ac tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:38.876876 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9c928fc3-4362-48cd-bd93-441ba7aa64ac tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:38.877362 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9c928fc3-4362-48cd-bd93-441ba7aa64ac tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:38.877790 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9c928fc3-4362-48cd-bd93-441ba7aa64ac tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:39.015273 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-9c928fc3-4362-48cd-bd93-441ba7aa64ac tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49947bfa2a5482d919ba0d4744553c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1b162d022d4c5ebd8c62dcad277727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:39.023641 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-9c928fc3-4362-48cd-bd93-441ba7aa64ac tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "GET /compute/v2.1/servers/795782c5-dd36-4185-b9cb-46377ec81275" status: 200 len: 1319 microversion: 2.1 time: 0.159936 Oct 24 08:58:39.024324 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 493/977] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:38 2022] GET /compute/v2.1/servers/795782c5-dd36-4185-b9cb-46377ec81275 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:40.050298 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-3d5c80f6-38ba-4ab0-a42c-d8ed791bcb3a tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:40.051019 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-3d5c80f6-38ba-4ab0-a42c-d8ed791bcb3a tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 795782c5-dd36-4185-b9cb-46377ec81275] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:40.057869 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3d5c80f6-38ba-4ab0-a42c-d8ed791bcb3a tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:40.058346 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3d5c80f6-38ba-4ab0-a42c-d8ed791bcb3a tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:40.058813 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3d5c80f6-38ba-4ab0-a42c-d8ed791bcb3a tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:40.059525 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3d5c80f6-38ba-4ab0-a42c-d8ed791bcb3a tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:40.059966 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3d5c80f6-38ba-4ab0-a42c-d8ed791bcb3a tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:40.060387 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3d5c80f6-38ba-4ab0-a42c-d8ed791bcb3a tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:40.191798 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-3d5c80f6-38ba-4ab0-a42c-d8ed791bcb3a tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49947bfa2a5482d919ba0d4744553c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1b162d022d4c5ebd8c62dcad277727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:58:40.199567 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-3d5c80f6-38ba-4ab0-a42c-d8ed791bcb3a tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "GET /compute/v2.1/servers/795782c5-dd36-4185-b9cb-46377ec81275" status: 200 len: 1508 microversion: 2.1 time: 0.155325 Oct 24 08:58:40.200115 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 485/978] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:58:40 2022] GET /compute/v2.1/servers/795782c5-dd36-4185-b9cb-46377ec81275 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:58:40.225110 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-69a4bd13-f436-4124-9106-ea06320c006d tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "669002c7-f1c9-464b-82de-ee42f95b9976", "device": "/dev/sdb"}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:40.229388 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-69a4bd13-f436-4124-9106-ea06320c006d tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 795782c5-dd36-4185-b9cb-46377ec81275] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:40.237710 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-69a4bd13-f436-4124-9106-ea06320c006d tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:40.238198 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-69a4bd13-f436-4124-9106-ea06320c006d tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:40.238631 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-69a4bd13-f436-4124-9106-ea06320c006d tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:40.239349 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-69a4bd13-f436-4124-9106-ea06320c006d tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:40.239806 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-69a4bd13-f436-4124-9106-ea06320c006d tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:40.240231 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-69a4bd13-f436-4124-9106-ea06320c006d tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:40.392428 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell0:SELECT=2 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:40.415961 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell0:SELECT=6 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:40.509248 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-69a4bd13-f436-4124-9106-ea06320c006d tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "POST /compute/v2.1/servers/795782c5-dd36-4185-b9cb-46377ec81275/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290284 Oct 24 08:58:40.509865 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 494/979] 10.222.0.26 () {60 vars in 1323 bytes} [Mon Oct 24 08:58:40 2022] POST /compute/v2.1/servers/795782c5-dd36-4185-b9cb-46377ec81275/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:58:43.061691 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell0:SELECT=2 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:43.108758 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-06116a10-15be-4e31-9072-b1a2928b7e28 req-93f32a1f-73b7-468d-9b98-443bb15ff90c admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "669002c7-f1c9-464b-82de-ee42f95b9976", "create_info": {"type": "qcow2", "new_file": "volume-669002c7-f1c9-464b-82de-ee42f95b9976.6838ffda-c77f-4ca2-b6bf-603e964b59e5.vhdx", "snapshot_id": "6838ffda-c77f-4ca2-b6bf-603e964b59e5"}}} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:43.112093 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-06116a10-15be-4e31-9072-b1a2928b7e28 req-93f32a1f-73b7-468d-9b98-443bb15ff90c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:43.112572 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-06116a10-15be-4e31-9072-b1a2928b7e28 req-93f32a1f-73b7-468d-9b98-443bb15ff90c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:43.112996 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-06116a10-15be-4e31-9072-b1a2928b7e28 req-93f32a1f-73b7-468d-9b98-443bb15ff90c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:43.121852 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-06116a10-15be-4e31-9072-b1a2928b7e28 req-93f32a1f-73b7-468d-9b98-443bb15ff90c admin admin] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:43.122311 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-06116a10-15be-4e31-9072-b1a2928b7e28 req-93f32a1f-73b7-468d-9b98-443bb15ff90c admin admin] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:43.122756 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-06116a10-15be-4e31-9072-b1a2928b7e28 req-93f32a1f-73b7-468d-9b98-443bb15ff90c admin admin] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:43.135983 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-06116a10-15be-4e31-9072-b1a2928b7e28 req-93f32a1f-73b7-468d-9b98-443bb15ff90c admin admin] 10.222.0.36 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.078736 Oct 24 08:58:43.136570 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 486/980] 10.222.0.36 () {64 vars in 1326 bytes} [Mon Oct 24 08:58:43 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:58:46.388844 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-06499868-f9d0-4ef3-9e25-55e4f7e7a891 req-38fdbef7-db6f-4bc5-8dcf-96baff01609f admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "669002c7-f1c9-464b-82de-ee42f95b9976", "create_info": {"type": "qcow2", "new_file": "volume-669002c7-f1c9-464b-82de-ee42f95b9976.02a5f744-bcf0-4f34-8e16-f4d52ff0fce5.vhdx", "snapshot_id": "02a5f744-bcf0-4f34-8e16-f4d52ff0fce5"}}} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:58:46.392301 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-06499868-f9d0-4ef3-9e25-55e4f7e7a891 req-38fdbef7-db6f-4bc5-8dcf-96baff01609f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:46.392780 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-06499868-f9d0-4ef3-9e25-55e4f7e7a891 req-38fdbef7-db6f-4bc5-8dcf-96baff01609f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:46.393217 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-06499868-f9d0-4ef3-9e25-55e4f7e7a891 req-38fdbef7-db6f-4bc5-8dcf-96baff01609f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:46.401839 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-06499868-f9d0-4ef3-9e25-55e4f7e7a891 req-38fdbef7-db6f-4bc5-8dcf-96baff01609f admin admin] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:46.402286 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-06499868-f9d0-4ef3-9e25-55e4f7e7a891 req-38fdbef7-db6f-4bc5-8dcf-96baff01609f admin admin] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:46.402750 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-06499868-f9d0-4ef3-9e25-55e4f7e7a891 req-38fdbef7-db6f-4bc5-8dcf-96baff01609f admin admin] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:46.417788 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-06499868-f9d0-4ef3-9e25-55e4f7e7a891 req-38fdbef7-db6f-4bc5-8dcf-96baff01609f admin admin] 10.222.0.36 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.080917 Oct 24 08:58:46.418240 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 495/981] 10.222.0.36 () {64 vars in 1326 bytes} [Mon Oct 24 08:58:46 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 08:58:49.490766 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-99bac656-adee-4113-8050-8dc990e6357f req-50402490-7a8e-40e9-9513-ba06d525e5e0 admin admin] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:49.493967 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-99bac656-adee-4113-8050-8dc990e6357f req-50402490-7a8e-40e9-9513-ba06d525e5e0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:49.494449 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-99bac656-adee-4113-8050-8dc990e6357f req-50402490-7a8e-40e9-9513-ba06d525e5e0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:49.494911 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-99bac656-adee-4113-8050-8dc990e6357f req-50402490-7a8e-40e9-9513-ba06d525e5e0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:49.503822 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-99bac656-adee-4113-8050-8dc990e6357f req-50402490-7a8e-40e9-9513-ba06d525e5e0 admin admin] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:49.504292 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-99bac656-adee-4113-8050-8dc990e6357f req-50402490-7a8e-40e9-9513-ba06d525e5e0 admin admin] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:49.504721 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-99bac656-adee-4113-8050-8dc990e6357f req-50402490-7a8e-40e9-9513-ba06d525e5e0 admin admin] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:49.518556 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-99bac656-adee-4113-8050-8dc990e6357f req-50402490-7a8e-40e9-9513-ba06d525e5e0 admin admin] 10.222.0.36 "DELETE /compute/v2.1/os-assisted-volume-snapshots/02a5f744-bcf0-4f34-8e16-f4d52ff0fce5?delete_info=%7B%22file_to_merge%22:%20%22volume-669002c7-f1c9-464b-82de-ee42f95b9976.02a5f744-bcf0-4f34-8e16-f4d52ff0fce5.vhdx%22,%20%22volume_id%22:%20%22669002c7-f1c9-464b-82de-ee42f95b9976%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.085448 Oct 24 08:58:49.519137 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 487/982] 10.222.0.36 () {62 vars in 1800 bytes} [Mon Oct 24 08:58:49 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/02a5f744-bcf0-4f34-8e16-f4d52ff0fce5?delete_info=%7B%22file_to_merge%22:%20%22volume-669002c7-f1c9-464b-82de-ee42f95b9976.02a5f744-bcf0-4f34-8e16-f4d52ff0fce5.vhdx%22,%20%22volume_id%22:%20%22669002c7-f1c9-464b-82de-ee42f95b9976%22%7D => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:58:52.616273 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:52.670761 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-3810ad96-622c-4964-a652-11963963d49d req-82756c0f-0dfa-4658-af6e-debba8ada5b4 admin admin] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:52.674024 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-3810ad96-622c-4964-a652-11963963d49d req-82756c0f-0dfa-4658-af6e-debba8ada5b4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:52.674528 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-3810ad96-622c-4964-a652-11963963d49d req-82756c0f-0dfa-4658-af6e-debba8ada5b4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:52.674979 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-3810ad96-622c-4964-a652-11963963d49d req-82756c0f-0dfa-4658-af6e-debba8ada5b4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:52.684391 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-3810ad96-622c-4964-a652-11963963d49d req-82756c0f-0dfa-4658-af6e-debba8ada5b4 admin admin] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:52.684856 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-3810ad96-622c-4964-a652-11963963d49d req-82756c0f-0dfa-4658-af6e-debba8ada5b4 admin admin] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:52.685277 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-3810ad96-622c-4964-a652-11963963d49d req-82756c0f-0dfa-4658-af6e-debba8ada5b4 admin admin] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:52.698725 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-3810ad96-622c-4964-a652-11963963d49d req-82756c0f-0dfa-4658-af6e-debba8ada5b4 admin admin] 10.222.0.36 "DELETE /compute/v2.1/os-assisted-volume-snapshots/2486df23-ab58-49a1-bf46-517fe6a06ba3?delete_info=%7B%22file_to_merge%22:%20%22volume-669002c7-f1c9-464b-82de-ee42f95b9976.2486df23-ab58-49a1-bf46-517fe6a06ba3.vhdx%22,%20%22volume_id%22:%20%22669002c7-f1c9-464b-82de-ee42f95b9976%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.084686 Oct 24 08:58:52.699326 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 496/983] 10.222.0.36 () {62 vars in 1800 bytes} [Mon Oct 24 08:58:52 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/2486df23-ab58-49a1-bf46-517fe6a06ba3?delete_info=%7B%22file_to_merge%22:%20%22volume-669002c7-f1c9-464b-82de-ee42f95b9976.2486df23-ab58-49a1-bf46-517fe6a06ba3.vhdx%22,%20%22volume_id%22:%20%22669002c7-f1c9-464b-82de-ee42f95b9976%22%7D => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:58:56.831034 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:56.891507 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-4e613396-6133-428d-8bce-f834e7649893 req-43cb31e6-71e9-4129-9838-8ec1c161405e admin admin] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:56.894805 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-4e613396-6133-428d-8bce-f834e7649893 req-43cb31e6-71e9-4129-9838-8ec1c161405e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:56.895234 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-4e613396-6133-428d-8bce-f834e7649893 req-43cb31e6-71e9-4129-9838-8ec1c161405e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:56.895662 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-4e613396-6133-428d-8bce-f834e7649893 req-43cb31e6-71e9-4129-9838-8ec1c161405e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:56.904105 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-4e613396-6133-428d-8bce-f834e7649893 req-43cb31e6-71e9-4129-9838-8ec1c161405e admin admin] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:56.904575 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-4e613396-6133-428d-8bce-f834e7649893 req-43cb31e6-71e9-4129-9838-8ec1c161405e admin admin] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:56.905004 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-4e613396-6133-428d-8bce-f834e7649893 req-43cb31e6-71e9-4129-9838-8ec1c161405e admin admin] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:56.907610 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell1:SELECT=34 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:56.920965 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-4e613396-6133-428d-8bce-f834e7649893 req-43cb31e6-71e9-4129-9838-8ec1c161405e admin admin] 10.222.0.36 "DELETE /compute/v2.1/os-assisted-volume-snapshots/6838ffda-c77f-4ca2-b6bf-603e964b59e5?delete_info=%7B%22file_to_merge%22:%20%22volume-669002c7-f1c9-464b-82de-ee42f95b9976.6838ffda-c77f-4ca2-b6bf-603e964b59e5.vhdx%22,%20%22volume_id%22:%20%22669002c7-f1c9-464b-82de-ee42f95b9976%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.090597 Oct 24 08:58:56.921496 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 488/984] 10.222.0.36 () {62 vars in 1800 bytes} [Mon Oct 24 08:58:56 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/6838ffda-c77f-4ca2-b6bf-603e964b59e5?delete_info=%7B%22file_to_merge%22:%20%22volume-669002c7-f1c9-464b-82de-ee42f95b9976.6838ffda-c77f-4ca2-b6bf-603e964b59e5.vhdx%22,%20%22volume_id%22:%20%22669002c7-f1c9-464b-82de-ee42f95b9976%22%7D => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:58:59.866745 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-20cc325a-90a9-4ef5-8d3a-0870ed9ded86 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:58:59.867341 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-20cc325a-90a9-4ef5-8d3a-0870ed9ded86 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 795782c5-dd36-4185-b9cb-46377ec81275] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:58:59.873909 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-20cc325a-90a9-4ef5-8d3a-0870ed9ded86 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:59.874392 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-20cc325a-90a9-4ef5-8d3a-0870ed9ded86 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:59.874857 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-20cc325a-90a9-4ef5-8d3a-0870ed9ded86 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:59.875546 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-20cc325a-90a9-4ef5-8d3a-0870ed9ded86 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:58:59.875990 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-20cc325a-90a9-4ef5-8d3a-0870ed9ded86 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:58:59.876419 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-20cc325a-90a9-4ef5-8d3a-0870ed9ded86 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:58:59.963906 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.objects.instance [None req-20cc325a-90a9-4ef5-8d3a-0870ed9ded86 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lazy-loading 'services' on Instance uuid 795782c5-dd36-4185-b9cb-46377ec81275 {{(pid=125164) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:59:00.056453 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-20cc325a-90a9-4ef5-8d3a-0870ed9ded86 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "DELETE /compute/v2.1/servers/795782c5-dd36-4185-b9cb-46377ec81275/os-volume_attachments/669002c7-f1c9-464b-82de-ee42f95b9976" status: 202 len: 0 microversion: 2.1 time: 0.194041 Oct 24 08:59:00.057282 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 497/985] 10.222.0.26 () {58 vars in 1416 bytes} [Mon Oct 24 08:58:59 2022] DELETE /compute/v2.1/servers/795782c5-dd36-4185-b9cb-46377ec81275/os-volume_attachments/669002c7-f1c9-464b-82de-ee42f95b9976 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:59:01.187304 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-2bd84245-62f8-4035-8dbf-307daf24bf67 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:01.187903 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-2bd84245-62f8-4035-8dbf-307daf24bf67 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 795782c5-dd36-4185-b9cb-46377ec81275] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:01.194750 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2bd84245-62f8-4035-8dbf-307daf24bf67 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:01.195250 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2bd84245-62f8-4035-8dbf-307daf24bf67 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:01.195687 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2bd84245-62f8-4035-8dbf-307daf24bf67 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:01.196381 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2bd84245-62f8-4035-8dbf-307daf24bf67 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:01.196829 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2bd84245-62f8-4035-8dbf-307daf24bf67 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:01.197250 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2bd84245-62f8-4035-8dbf-307daf24bf67 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:01.222676 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-2bd84245-62f8-4035-8dbf-307daf24bf67 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 795782c5-dd36-4185-b9cb-46377ec81275] Going to try to terminate instance {{(pid=125165) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 08:59:01.303229 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-2bd84245-62f8-4035-8dbf-307daf24bf67 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "DELETE /compute/v2.1/servers/795782c5-dd36-4185-b9cb-46377ec81275" status: 204 len: 0 microversion: 2.1 time: 0.120505 Oct 24 08:59:01.303796 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 489/986] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Oct 24 08:59:01 2022] DELETE /compute/v2.1/servers/795782c5-dd36-4185-b9cb-46377ec81275 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 08:59:01.314542 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-63547f2a-e60b-48d3-9e90-be44019a288c tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:01.315267 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-63547f2a-e60b-48d3-9e90-be44019a288c tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 795782c5-dd36-4185-b9cb-46377ec81275] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:01.321556 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-63547f2a-e60b-48d3-9e90-be44019a288c tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:01.322039 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-63547f2a-e60b-48d3-9e90-be44019a288c tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:01.322471 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-63547f2a-e60b-48d3-9e90-be44019a288c tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:01.323191 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-63547f2a-e60b-48d3-9e90-be44019a288c tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:01.323671 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-63547f2a-e60b-48d3-9e90-be44019a288c tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:01.324091 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-63547f2a-e60b-48d3-9e90-be44019a288c tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:01.326655 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:01.459881 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-63547f2a-e60b-48d3-9e90-be44019a288c tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49947bfa2a5482d919ba0d4744553c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1b162d022d4c5ebd8c62dcad277727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:01.468076 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-63547f2a-e60b-48d3-9e90-be44019a288c tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "GET /compute/v2.1/servers/795782c5-dd36-4185-b9cb-46377ec81275" status: 200 len: 1514 microversion: 2.1 time: 0.159338 Oct 24 08:59:01.468751 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 498/987] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:01 2022] GET /compute/v2.1/servers/795782c5-dd36-4185-b9cb-46377ec81275 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:02.496270 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-266adf8f-d036-4010-b863-d6ffb63c043e tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:02.497515 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-266adf8f-d036-4010-b863-d6ffb63c043e tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 795782c5-dd36-4185-b9cb-46377ec81275] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:02.505240 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-266adf8f-d036-4010-b863-d6ffb63c043e tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:02.505728 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-266adf8f-d036-4010-b863-d6ffb63c043e tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:02.506164 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-266adf8f-d036-4010-b863-d6ffb63c043e tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:02.506888 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-266adf8f-d036-4010-b863-d6ffb63c043e tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:02.507339 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-266adf8f-d036-4010-b863-d6ffb63c043e tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:02.507760 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-266adf8f-d036-4010-b863-d6ffb63c043e tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:02.648756 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-266adf8f-d036-4010-b863-d6ffb63c043e tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49947bfa2a5482d919ba0d4744553c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1b162d022d4c5ebd8c62dcad277727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:02.656825 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-266adf8f-d036-4010-b863-d6ffb63c043e tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "GET /compute/v2.1/servers/795782c5-dd36-4185-b9cb-46377ec81275" status: 200 len: 1514 microversion: 2.1 time: 0.167855 Oct 24 08:59:02.657370 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 490/988] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:02 2022] GET /compute/v2.1/servers/795782c5-dd36-4185-b9cb-46377ec81275 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:03.685375 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-336e9a38-d6f3-47d5-ab9a-fcda29f927dc tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:03.686351 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-336e9a38-d6f3-47d5-ab9a-fcda29f927dc tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 795782c5-dd36-4185-b9cb-46377ec81275] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:03.689047 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell0:SELECT=4 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:03.694744 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-336e9a38-d6f3-47d5-ab9a-fcda29f927dc tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:03.695254 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-336e9a38-d6f3-47d5-ab9a-fcda29f927dc tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:03.695690 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-336e9a38-d6f3-47d5-ab9a-fcda29f927dc tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:03.696375 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-336e9a38-d6f3-47d5-ab9a-fcda29f927dc tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:03.696827 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-336e9a38-d6f3-47d5-ab9a-fcda29f927dc tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:03.697248 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-336e9a38-d6f3-47d5-ab9a-fcda29f927dc tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:03.825632 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-336e9a38-d6f3-47d5-ab9a-fcda29f927dc tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49947bfa2a5482d919ba0d4744553c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1b162d022d4c5ebd8c62dcad277727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:03.833721 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-336e9a38-d6f3-47d5-ab9a-fcda29f927dc tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "GET /compute/v2.1/servers/795782c5-dd36-4185-b9cb-46377ec81275" status: 200 len: 1514 microversion: 2.1 time: 0.154993 Oct 24 08:59:03.834255 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 499/989] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:03 2022] GET /compute/v2.1/servers/795782c5-dd36-4185-b9cb-46377ec81275 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:04.861367 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-bc59d8f7-05be-4ba2-ae75-78b7cf83a63f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:04.862094 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-bc59d8f7-05be-4ba2-ae75-78b7cf83a63f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 795782c5-dd36-4185-b9cb-46377ec81275] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:04.870027 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bc59d8f7-05be-4ba2-ae75-78b7cf83a63f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:04.870628 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bc59d8f7-05be-4ba2-ae75-78b7cf83a63f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:04.871187 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bc59d8f7-05be-4ba2-ae75-78b7cf83a63f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:04.871984 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bc59d8f7-05be-4ba2-ae75-78b7cf83a63f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:04.872522 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bc59d8f7-05be-4ba2-ae75-78b7cf83a63f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:04.873016 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-bc59d8f7-05be-4ba2-ae75-78b7cf83a63f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:05.010974 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-bc59d8f7-05be-4ba2-ae75-78b7cf83a63f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49947bfa2a5482d919ba0d4744553c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1b162d022d4c5ebd8c62dcad277727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:05.018998 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-bc59d8f7-05be-4ba2-ae75-78b7cf83a63f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "GET /compute/v2.1/servers/795782c5-dd36-4185-b9cb-46377ec81275" status: 200 len: 1514 microversion: 2.1 time: 0.162320 Oct 24 08:59:05.019562 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 491/990] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:04 2022] GET /compute/v2.1/servers/795782c5-dd36-4185-b9cb-46377ec81275 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:06.044090 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-a7f5dc8f-1437-4ca1-97ef-6226d12aa998 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:06.044646 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-a7f5dc8f-1437-4ca1-97ef-6226d12aa998 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 795782c5-dd36-4185-b9cb-46377ec81275] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:06.050922 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a7f5dc8f-1437-4ca1-97ef-6226d12aa998 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:06.051731 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a7f5dc8f-1437-4ca1-97ef-6226d12aa998 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:06.052348 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a7f5dc8f-1437-4ca1-97ef-6226d12aa998 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:06.053070 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a7f5dc8f-1437-4ca1-97ef-6226d12aa998 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:06.053508 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a7f5dc8f-1437-4ca1-97ef-6226d12aa998 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:06.053930 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a7f5dc8f-1437-4ca1-97ef-6226d12aa998 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:06.148432 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-a7f5dc8f-1437-4ca1-97ef-6226d12aa998 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49947bfa2a5482d919ba0d4744553c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1b162d022d4c5ebd8c62dcad277727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:06.157178 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-a7f5dc8f-1437-4ca1-97ef-6226d12aa998 tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "GET /compute/v2.1/servers/795782c5-dd36-4185-b9cb-46377ec81275" status: 200 len: 1472 microversion: 2.1 time: 0.117082 Oct 24 08:59:06.157831 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 500/991] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:06 2022] GET /compute/v2.1/servers/795782c5-dd36-4185-b9cb-46377ec81275 => generated 1472 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:06.162128 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-3e36e2e6-b722-4c8c-ad48-304cfbfe3337 req-c3edcdac-8ce3-4a42-80f2-50b71bcc66a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "795782c5-dd36-4185-b9cb-46377ec81275", "name": "network-vif-deleted", "tag": "d24bc1d0-a568-4363-8513-9b81dbdec060"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:06.173625 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-3e36e2e6-b722-4c8c-ad48-304cfbfe3337 req-c3edcdac-8ce3-4a42-80f2-50b71bcc66a9 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:06.174097 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-3e36e2e6-b722-4c8c-ad48-304cfbfe3337 req-c3edcdac-8ce3-4a42-80f2-50b71bcc66a9 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:06.174523 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-3e36e2e6-b722-4c8c-ad48-304cfbfe3337 req-c3edcdac-8ce3-4a42-80f2-50b71bcc66a9 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:06.190864 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-3e36e2e6-b722-4c8c-ad48-304cfbfe3337 req-c3edcdac-8ce3-4a42-80f2-50b71bcc66a9 service nova] Creating event network-vif-deleted:d24bc1d0-a568-4363-8513-9b81dbdec060 for instance 795782c5-dd36-4185-b9cb-46377ec81275 on hv-cinder-maste Oct 24 08:59:06.196524 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-3e36e2e6-b722-4c8c-ad48-304cfbfe3337 req-c3edcdac-8ce3-4a42-80f2-50b71bcc66a9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038221 Oct 24 08:59:06.197368 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 492/992] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:59:07.186627 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-543a3ee2-167e-4382-8509-1231d3eb4d0f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:07.187746 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-543a3ee2-167e-4382-8509-1231d3eb4d0f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] [instance: 795782c5-dd36-4185-b9cb-46377ec81275] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:07.199414 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-543a3ee2-167e-4382-8509-1231d3eb4d0f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:07.200281 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-543a3ee2-167e-4382-8509-1231d3eb4d0f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:07.201090 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-543a3ee2-167e-4382-8509-1231d3eb4d0f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:07.202304 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-543a3ee2-167e-4382-8509-1231d3eb4d0f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:07.202993 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-543a3ee2-167e-4382-8509-1231d3eb4d0f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:07.203467 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-543a3ee2-167e-4382-8509-1231d3eb4d0f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:07.219419 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.wsgi [None req-543a3ee2-167e-4382-8509-1231d3eb4d0f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] HTTP exception thrown: Instance 795782c5-dd36-4185-b9cb-46377ec81275 could not be found. Oct 24 08:59:07.221129 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-543a3ee2-167e-4382-8509-1231d3eb4d0f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Request method failure captured: Oct 24 08:59:07.221129 dv-cinder-master-3-smb devstack@n-api.service[125164]: request: GET /compute/v2.1/servers/795782c5-dd36-4185-b9cb-46377ec81275 HTTP/1.1 Oct 24 08:59:07.221129 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept: application/json Oct 24 08:59:07.221129 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept-Encoding: identity Oct 24 08:59:07.221129 dv-cinder-master-3-smb devstack@n-api.service[125164]: Connection: close Oct 24 08:59:07.221129 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Length: 0 Oct 24 08:59:07.221129 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Type: application/json Oct 24 08:59:07.221129 dv-cinder-master-3-smb devstack@n-api.service[125164]: Host: 10.222.0.26 Oct 24 08:59:07.221129 dv-cinder-master-3-smb devstack@n-api.service[125164]: Openstack-System-Scope: None Oct 24 08:59:07.221129 dv-cinder-master-3-smb devstack@n-api.service[125164]: User-Agent: python-urllib3/1.26.12 Oct 24 08:59:07.221129 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Auth-Token: gAAAAABjVlNwMIPXw2xRjVN_esL7qXUuo9UNFfng4IMopL_kqqWS-uFu8PxfKWurzfG7R5RSk396zjIxxcTvWEvKnakCvg5rNJI0UdwJk_XxUIGNbuFG1fNegl1TjChe_OZQsnlcCuNm076ktfwptPDC75dPyQxR9ZPlywvk18Q1ABZ3dj3V5SU Oct 24 08:59:07.221129 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Id: None Oct 24 08:59:07.221129 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Name: None Oct 24 08:59:07.221129 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Identity-Status: Confirmed Oct 24 08:59:07.221129 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Is-Admin-Project: True Oct 24 08:59:07.221129 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Id: default Oct 24 08:59:07.221129 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Name: Default Oct 24 08:59:07.221129 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Id: 0b1b162d022d4c5ebd8c62dcad277727 Oct 24 08:59:07.221129 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Name: tempest-VolumesSnapshotTestJSON-157810618 Oct 24 08:59:07.221129 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Role: reader,member Oct 24 08:59:07.221129 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Roles: reader,member Oct 24 08:59:07.222806 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b1b162d022d4c5ebd8c62dcad277727", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b1b162d022d4c5ebd8c62dcad277727"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b1b162d022d4c5ebd8c62dcad277727"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b1b162d022d4c5ebd8c62dcad277727"}]}] Oct 24 08:59:07.222806 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant: tempest-VolumesSnapshotTestJSON-157810618 Oct 24 08:59:07.222806 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Id: 0b1b162d022d4c5ebd8c62dcad277727 Oct 24 08:59:07.222806 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-157810618 Oct 24 08:59:07.222806 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User: tempest-VolumesSnapshotTestJSON-157810618-project Oct 24 08:59:07.222806 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Id: default Oct 24 08:59:07.222806 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Name: Default Oct 24 08:59:07.222806 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Id: a49947bfa2a5482d919ba0d4744553c7 Oct 24 08:59:07.222806 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Name: tempest-VolumesSnapshotTestJSON-157810618-project Oct 24 08:59:07.222806 dv-cinder-master-3-smb devstack@n-api.service[125164]: method: > Oct 24 08:59:07.222806 dv-cinder-master-3-smb devstack@n-api.service[125164]: exception: Instance 795782c5-dd36-4185-b9cb-46377ec81275 could not be found. Oct 24 08:59:07.222806 dv-cinder-master-3-smb devstack@n-api.service[125164]: action_args: {'id': '795782c5-dd36-4185-b9cb-46377ec81275'} Oct 24 08:59:07.223936 dv-cinder-master-3-smb devstack@n-api.service[125164]: {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 08:59:07.223936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:59:07.223936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 08:59:07.223936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 08:59:07.223936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 08:59:07.223936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 08:59:07.223936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 08:59:07.223936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 08:59:07.223936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 08:59:07.223936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 08:59:07.223936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 795782c5-dd36-4185-b9cb-46377ec81275 could not be found. Oct 24 08:59:07.223936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:59:07.223936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:59:07.223936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:59:07.223936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:59:07.223936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:59:07.223936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:59:07.223936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 08:59:07.223936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 08:59:07.223936 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 08:59:07.225559 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 08:59:07.225559 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 08:59:07.225559 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 08:59:07.225559 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 08:59:07.225559 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 08:59:07.225559 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 08:59:07.225559 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 08:59:07.225559 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 795782c5-dd36-4185-b9cb-46377ec81275 could not be found. Oct 24 08:59:07.225559 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:59:07.225559 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 08:59:07.225559 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:59:07.225559 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 08:59:07.225559 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 08:59:07.225559 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 08:59:07.225559 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 08:59:07.225559 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 08:59:07.225559 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 795782c5-dd36-4185-b9cb-46377ec81275 could not be found. Oct 24 08:59:07.225559 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 08:59:07.226927 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-543a3ee2-167e-4382-8509-1231d3eb4d0f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] Returning 404 to user: Instance 795782c5-dd36-4185-b9cb-46377ec81275 could not be found. {{(pid=125164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 08:59:07.226927 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-543a3ee2-167e-4382-8509-1231d3eb4d0f tempest-VolumesSnapshotTestJSON-157810618 tempest-VolumesSnapshotTestJSON-157810618-project] 10.222.0.26 "GET /compute/v2.1/servers/795782c5-dd36-4185-b9cb-46377ec81275" status: 404 len: 111 microversion: 2.1 time: 0.043530 Oct 24 08:59:07.226927 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 501/993] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:07 2022] GET /compute/v2.1/servers/795782c5-dd36-4185-b9cb-46377ec81275 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 08:59:24.028809 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell0:SELECT=6 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:24.030873 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:24.031990 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:24.038980 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-63870b78-9232-4975-bef4-f43137e681e6 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:24.039980 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-63870b78-9232-4975-bef4-f43137e681e6 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:24.053690 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-63870b78-9232-4975-bef4-f43137e681e6 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:24.054166 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-63870b78-9232-4975-bef4-f43137e681e6 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:24.054597 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-63870b78-9232-4975-bef4-f43137e681e6 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:24.055298 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-63870b78-9232-4975-bef4-f43137e681e6 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:24.055743 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-63870b78-9232-4975-bef4-f43137e681e6 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:24.056160 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-63870b78-9232-4975-bef4-f43137e681e6 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:24.079343 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.objects.instance [None req-63870b78-9232-4975-bef4-f43137e681e6 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lazy-loading 'flavor' on Instance uuid b6a3aec5-42e2-40ea-a383-0e2bf1a52771 {{(pid=125165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 08:59:24.155303 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-63870b78-9232-4975-bef4-f43137e681e6 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "POST /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771/action" status: 202 len: 0 microversion: 2.1 time: 0.128361 Oct 24 08:59:24.155886 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 493/994] 10.222.0.26 () {60 vars in 1278 bytes} [Mon Oct 24 08:59:24 2022] POST /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:59:24.164507 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-11a551e9-4b46-4514-945a-d057fcd24d92 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:24.165104 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-11a551e9-4b46-4514-945a-d057fcd24d92 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:24.167590 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_api:SELECT=10 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:24.168232 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell1:SELECT=19 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:24.174577 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-11a551e9-4b46-4514-945a-d057fcd24d92 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:24.175216 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-11a551e9-4b46-4514-945a-d057fcd24d92 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:24.176019 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-11a551e9-4b46-4514-945a-d057fcd24d92 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:24.177557 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-11a551e9-4b46-4514-945a-d057fcd24d92 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:24.178324 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-11a551e9-4b46-4514-945a-d057fcd24d92 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:24.179137 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-11a551e9-4b46-4514-945a-d057fcd24d92 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:24.316974 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-11a551e9-4b46-4514-945a-d057fcd24d92 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c4228e92254a65ada3a0a777812103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2806e58f714af7a7f739a59d3dece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:24.325027 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-11a551e9-4b46-4514-945a-d057fcd24d92 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771" status: 200 len: 1566 microversion: 2.1 time: 0.164580 Oct 24 08:59:24.325584 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 502/995] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:24 2022] GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:25.354061 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-cc6d352e-0db8-42a1-b353-bd78fcc7909c tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:25.355249 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-cc6d352e-0db8-42a1-b353-bd78fcc7909c tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:25.365577 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cc6d352e-0db8-42a1-b353-bd78fcc7909c tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:25.366059 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cc6d352e-0db8-42a1-b353-bd78fcc7909c tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:25.366487 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cc6d352e-0db8-42a1-b353-bd78fcc7909c tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:25.367221 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cc6d352e-0db8-42a1-b353-bd78fcc7909c tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:25.367664 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cc6d352e-0db8-42a1-b353-bd78fcc7909c tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:25.368078 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-cc6d352e-0db8-42a1-b353-bd78fcc7909c tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:25.504659 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-cc6d352e-0db8-42a1-b353-bd78fcc7909c tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c4228e92254a65ada3a0a777812103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2806e58f714af7a7f739a59d3dece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:25.513107 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-cc6d352e-0db8-42a1-b353-bd78fcc7909c tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771" status: 200 len: 1566 microversion: 2.1 time: 0.166929 Oct 24 08:59:25.513676 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 494/996] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:25 2022] GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:26.536059 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-e2f92c94-72d2-4478-9686-3154cc68cf12 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:26.536733 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-e2f92c94-72d2-4478-9686-3154cc68cf12 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:26.543048 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e2f92c94-72d2-4478-9686-3154cc68cf12 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:26.543533 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e2f92c94-72d2-4478-9686-3154cc68cf12 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:26.543968 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e2f92c94-72d2-4478-9686-3154cc68cf12 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:26.544657 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e2f92c94-72d2-4478-9686-3154cc68cf12 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:26.545109 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e2f92c94-72d2-4478-9686-3154cc68cf12 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:26.545674 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-e2f92c94-72d2-4478-9686-3154cc68cf12 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:26.677436 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-e2f92c94-72d2-4478-9686-3154cc68cf12 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c4228e92254a65ada3a0a777812103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2806e58f714af7a7f739a59d3dece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:26.685559 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-e2f92c94-72d2-4478-9686-3154cc68cf12 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771" status: 200 len: 1566 microversion: 2.1 time: 0.153698 Oct 24 08:59:26.686118 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 503/997] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:26 2022] GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:27.708953 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-b5847955-0696-401d-8f36-eedf01fef8df tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:27.709568 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-b5847955-0696-401d-8f36-eedf01fef8df tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:27.716077 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b5847955-0696-401d-8f36-eedf01fef8df tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:27.716562 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b5847955-0696-401d-8f36-eedf01fef8df tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:27.716993 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b5847955-0696-401d-8f36-eedf01fef8df tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:27.717676 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b5847955-0696-401d-8f36-eedf01fef8df tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:27.718117 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b5847955-0696-401d-8f36-eedf01fef8df tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:27.718563 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-b5847955-0696-401d-8f36-eedf01fef8df tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:27.858947 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-b5847955-0696-401d-8f36-eedf01fef8df tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c4228e92254a65ada3a0a777812103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2806e58f714af7a7f739a59d3dece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:27.867281 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-b5847955-0696-401d-8f36-eedf01fef8df tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771" status: 200 len: 1566 microversion: 2.1 time: 0.162359 Oct 24 08:59:27.867805 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 495/998] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:27 2022] GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:28.892584 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-1a6b51bb-5629-4ed5-950b-408860cdeda3 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:28.892584 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-1a6b51bb-5629-4ed5-950b-408860cdeda3 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:28.898255 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1a6b51bb-5629-4ed5-950b-408860cdeda3 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:28.898820 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1a6b51bb-5629-4ed5-950b-408860cdeda3 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:28.899259 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1a6b51bb-5629-4ed5-950b-408860cdeda3 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:28.899935 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1a6b51bb-5629-4ed5-950b-408860cdeda3 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:28.900996 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1a6b51bb-5629-4ed5-950b-408860cdeda3 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:28.900996 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-1a6b51bb-5629-4ed5-950b-408860cdeda3 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:29.039062 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-1a6b51bb-5629-4ed5-950b-408860cdeda3 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c4228e92254a65ada3a0a777812103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2806e58f714af7a7f739a59d3dece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:29.051431 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-1a6b51bb-5629-4ed5-950b-408860cdeda3 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771" status: 200 len: 1566 microversion: 2.1 time: 0.163637 Oct 24 08:59:29.052330 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 504/999] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:28 2022] GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:30.074748 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-2764323e-13f6-4aa8-ac6b-1819352aa4f1 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:30.075366 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-2764323e-13f6-4aa8-ac6b-1819352aa4f1 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:30.081994 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2764323e-13f6-4aa8-ac6b-1819352aa4f1 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:30.082372 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2764323e-13f6-4aa8-ac6b-1819352aa4f1 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:30.082868 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2764323e-13f6-4aa8-ac6b-1819352aa4f1 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:30.084883 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2764323e-13f6-4aa8-ac6b-1819352aa4f1 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:30.085221 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2764323e-13f6-4aa8-ac6b-1819352aa4f1 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:30.085624 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-2764323e-13f6-4aa8-ac6b-1819352aa4f1 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:30.213601 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-2764323e-13f6-4aa8-ac6b-1819352aa4f1 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c4228e92254a65ada3a0a777812103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2806e58f714af7a7f739a59d3dece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:30.221396 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-2764323e-13f6-4aa8-ac6b-1819352aa4f1 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771" status: 200 len: 1566 microversion: 2.1 time: 0.150493 Oct 24 08:59:30.221960 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 496/1000] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:30 2022] GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:31.244848 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-4afc283d-10d4-4b19-a28a-2305ad5a713a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:31.245456 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-4afc283d-10d4-4b19-a28a-2305ad5a713a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:31.251995 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4afc283d-10d4-4b19-a28a-2305ad5a713a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:31.252482 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4afc283d-10d4-4b19-a28a-2305ad5a713a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:31.252912 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4afc283d-10d4-4b19-a28a-2305ad5a713a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:31.253625 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4afc283d-10d4-4b19-a28a-2305ad5a713a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:31.254064 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4afc283d-10d4-4b19-a28a-2305ad5a713a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:31.254484 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-4afc283d-10d4-4b19-a28a-2305ad5a713a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:31.393246 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-4afc283d-10d4-4b19-a28a-2305ad5a713a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c4228e92254a65ada3a0a777812103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2806e58f714af7a7f739a59d3dece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:31.401856 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-4afc283d-10d4-4b19-a28a-2305ad5a713a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771" status: 200 len: 1566 microversion: 2.1 time: 0.161185 Oct 24 08:59:31.402434 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 505/1001] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:31 2022] GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:32.425090 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-99d2468a-09fd-412d-8d0d-83e64e512bad tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:32.426020 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-99d2468a-09fd-412d-8d0d-83e64e512bad tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:32.440336 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-99d2468a-09fd-412d-8d0d-83e64e512bad tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:32.441090 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-99d2468a-09fd-412d-8d0d-83e64e512bad tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:32.441839 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-99d2468a-09fd-412d-8d0d-83e64e512bad tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:32.442969 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-99d2468a-09fd-412d-8d0d-83e64e512bad tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:32.443705 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-99d2468a-09fd-412d-8d0d-83e64e512bad tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:32.444526 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-99d2468a-09fd-412d-8d0d-83e64e512bad tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:32.581532 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-99d2468a-09fd-412d-8d0d-83e64e512bad tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c4228e92254a65ada3a0a777812103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2806e58f714af7a7f739a59d3dece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:32.589441 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-99d2468a-09fd-412d-8d0d-83e64e512bad tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771" status: 200 len: 1566 microversion: 2.1 time: 0.168275 Oct 24 08:59:32.590019 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 497/1002] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:32 2022] GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:33.616861 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-5239b3b7-6804-4100-a8c2-b1eb0b87dfe7 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:33.617849 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-5239b3b7-6804-4100-a8c2-b1eb0b87dfe7 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:33.628609 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5239b3b7-6804-4100-a8c2-b1eb0b87dfe7 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:33.629448 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5239b3b7-6804-4100-a8c2-b1eb0b87dfe7 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:33.630174 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5239b3b7-6804-4100-a8c2-b1eb0b87dfe7 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:33.631395 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5239b3b7-6804-4100-a8c2-b1eb0b87dfe7 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:33.632158 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5239b3b7-6804-4100-a8c2-b1eb0b87dfe7 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:33.632851 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-5239b3b7-6804-4100-a8c2-b1eb0b87dfe7 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:33.777093 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-5239b3b7-6804-4100-a8c2-b1eb0b87dfe7 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c4228e92254a65ada3a0a777812103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2806e58f714af7a7f739a59d3dece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:33.788821 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-5239b3b7-6804-4100-a8c2-b1eb0b87dfe7 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771" status: 200 len: 1566 microversion: 2.1 time: 0.178703 Oct 24 08:59:33.789602 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 506/1003] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:33 2022] GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771 => generated 1566 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:34.815529 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-f2ac8a06-1322-4dd4-8d81-fbc3668c0c22 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:34.816127 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-f2ac8a06-1322-4dd4-8d81-fbc3668c0c22 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:34.823183 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f2ac8a06-1322-4dd4-8d81-fbc3668c0c22 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:34.823670 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f2ac8a06-1322-4dd4-8d81-fbc3668c0c22 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:34.824103 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f2ac8a06-1322-4dd4-8d81-fbc3668c0c22 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:34.824793 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f2ac8a06-1322-4dd4-8d81-fbc3668c0c22 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:34.825250 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f2ac8a06-1322-4dd4-8d81-fbc3668c0c22 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:34.825674 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-f2ac8a06-1322-4dd4-8d81-fbc3668c0c22 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:35.273291 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-f2ac8a06-1322-4dd4-8d81-fbc3668c0c22 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c4228e92254a65ada3a0a777812103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2806e58f714af7a7f739a59d3dece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:35.281450 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-f2ac8a06-1322-4dd4-8d81-fbc3668c0c22 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771" status: 200 len: 1566 microversion: 2.1 time: 0.469787 Oct 24 08:59:35.282015 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 498/1004] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:34 2022] GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771 => generated 1566 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:36.303914 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-3e98fa1e-c3f0-4d4c-b47f-3ff917c86b52 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:36.304526 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-3e98fa1e-c3f0-4d4c-b47f-3ff917c86b52 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:36.311157 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3e98fa1e-c3f0-4d4c-b47f-3ff917c86b52 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:36.311644 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3e98fa1e-c3f0-4d4c-b47f-3ff917c86b52 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:36.312073 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3e98fa1e-c3f0-4d4c-b47f-3ff917c86b52 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:36.312750 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3e98fa1e-c3f0-4d4c-b47f-3ff917c86b52 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:36.313198 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3e98fa1e-c3f0-4d4c-b47f-3ff917c86b52 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:36.313616 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-3e98fa1e-c3f0-4d4c-b47f-3ff917c86b52 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:36.453813 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-3e98fa1e-c3f0-4d4c-b47f-3ff917c86b52 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c4228e92254a65ada3a0a777812103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2806e58f714af7a7f739a59d3dece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:36.461859 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-3e98fa1e-c3f0-4d4c-b47f-3ff917c86b52 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771" status: 200 len: 1566 microversion: 2.1 time: 0.162168 Oct 24 08:59:36.462426 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 507/1005] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:36 2022] GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:37.485547 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-346ade4b-c4bf-4b82-a8be-b7b8f36fff61 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:37.486180 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-346ade4b-c4bf-4b82-a8be-b7b8f36fff61 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:37.493141 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-346ade4b-c4bf-4b82-a8be-b7b8f36fff61 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:37.493624 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-346ade4b-c4bf-4b82-a8be-b7b8f36fff61 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:37.494067 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-346ade4b-c4bf-4b82-a8be-b7b8f36fff61 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:37.494759 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-346ade4b-c4bf-4b82-a8be-b7b8f36fff61 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:37.495224 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-346ade4b-c4bf-4b82-a8be-b7b8f36fff61 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:37.495644 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-346ade4b-c4bf-4b82-a8be-b7b8f36fff61 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:37.634970 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-346ade4b-c4bf-4b82-a8be-b7b8f36fff61 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c4228e92254a65ada3a0a777812103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2806e58f714af7a7f739a59d3dece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:37.643330 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-346ade4b-c4bf-4b82-a8be-b7b8f36fff61 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771" status: 200 len: 1507 microversion: 2.1 time: 0.161741 Oct 24 08:59:37.643898 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 499/1006] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:37 2022] GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:37.666075 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-cbf28bbb-5d63-456d-8a70-b080d427185e tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:37.666649 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-cbf28bbb-5d63-456d-8a70-b080d427185e tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:37.669169 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 08:59:37.669294 dv-cinder-master-3-smb devstack@n-api.service[125164]: Mon Oct 24 08:59:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771/action (ip 10.222.0.26) !!! Oct 24 08:59:37.675825 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cbf28bbb-5d63-456d-8a70-b080d427185e tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:37.676328 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cbf28bbb-5d63-456d-8a70-b080d427185e tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:37.676750 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cbf28bbb-5d63-456d-8a70-b080d427185e tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:37.677442 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cbf28bbb-5d63-456d-8a70-b080d427185e tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:37.677878 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cbf28bbb-5d63-456d-8a70-b080d427185e tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:37.678297 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-cbf28bbb-5d63-456d-8a70-b080d427185e tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:37.710248 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-cbf28bbb-5d63-456d-8a70-b080d427185e tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125164) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 24 08:59:37.784548 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-cbf28bbb-5d63-456d-8a70-b080d427185e tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "POST /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771/action" status: 202 len: 0 microversion: 2.1 time: 0.122579 Oct 24 08:59:37.785189 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 508/1007] 10.222.0.26 () {60 vars in 1278 bytes} [Mon Oct 24 08:59:37 2022] POST /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 08:59:37.794104 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-ebe27d1d-ddfd-454e-bcca-9904a691d492 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:37.794883 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-ebe27d1d-ddfd-454e-bcca-9904a691d492 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:37.801465 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ebe27d1d-ddfd-454e-bcca-9904a691d492 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:37.802056 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ebe27d1d-ddfd-454e-bcca-9904a691d492 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:37.802646 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ebe27d1d-ddfd-454e-bcca-9904a691d492 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:37.803469 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ebe27d1d-ddfd-454e-bcca-9904a691d492 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:37.804006 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ebe27d1d-ddfd-454e-bcca-9904a691d492 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:37.804484 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-ebe27d1d-ddfd-454e-bcca-9904a691d492 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:37.943409 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-ebe27d1d-ddfd-454e-bcca-9904a691d492 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c4228e92254a65ada3a0a777812103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2806e58f714af7a7f739a59d3dece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:37.951117 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-ebe27d1d-ddfd-454e-bcca-9904a691d492 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771" status: 200 len: 1515 microversion: 2.1 time: 0.161312 Oct 24 08:59:37.951998 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 500/1008] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:37 2022] GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:38.974902 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-449799e0-bd8d-40a9-be93-ddc5d055c719 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:38.975641 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-449799e0-bd8d-40a9-be93-ddc5d055c719 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:38.982153 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-449799e0-bd8d-40a9-be93-ddc5d055c719 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:38.982666 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-449799e0-bd8d-40a9-be93-ddc5d055c719 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:38.983118 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-449799e0-bd8d-40a9-be93-ddc5d055c719 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:38.983831 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-449799e0-bd8d-40a9-be93-ddc5d055c719 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:38.984294 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-449799e0-bd8d-40a9-be93-ddc5d055c719 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:38.984705 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-449799e0-bd8d-40a9-be93-ddc5d055c719 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:39.120910 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-449799e0-bd8d-40a9-be93-ddc5d055c719 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c4228e92254a65ada3a0a777812103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2806e58f714af7a7f739a59d3dece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:39.129174 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-449799e0-bd8d-40a9-be93-ddc5d055c719 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771" status: 200 len: 1517 microversion: 2.1 time: 0.159106 Oct 24 08:59:39.129722 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 509/1009] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:38 2022] GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:40.153295 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-a6294790-a8fc-4b94-89c2-25c7f0821663 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:40.153944 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-a6294790-a8fc-4b94-89c2-25c7f0821663 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:40.160293 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a6294790-a8fc-4b94-89c2-25c7f0821663 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:40.160779 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a6294790-a8fc-4b94-89c2-25c7f0821663 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:40.161208 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a6294790-a8fc-4b94-89c2-25c7f0821663 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:40.161899 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a6294790-a8fc-4b94-89c2-25c7f0821663 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:40.162382 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a6294790-a8fc-4b94-89c2-25c7f0821663 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:40.162802 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-a6294790-a8fc-4b94-89c2-25c7f0821663 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:40.262224 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-38bcded9-06a2-49eb-97a9-8f26d462e36f req-8a565662-34b9-4b5a-a17b-a454fe3ea6c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6a3aec5-42e2-40ea-a383-0e2bf1a52771", "name": "network-vif-unplugged", "status": "completed", "tag": "d1cd745a-6478-4f59-ad2c-346b7fe41e9f"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:40.271745 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-38bcded9-06a2-49eb-97a9-8f26d462e36f req-8a565662-34b9-4b5a-a17b-a454fe3ea6c4 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:40.272220 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-38bcded9-06a2-49eb-97a9-8f26d462e36f req-8a565662-34b9-4b5a-a17b-a454fe3ea6c4 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:40.272639 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-38bcded9-06a2-49eb-97a9-8f26d462e36f req-8a565662-34b9-4b5a-a17b-a454fe3ea6c4 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:40.284032 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-38bcded9-06a2-49eb-97a9-8f26d462e36f req-8a565662-34b9-4b5a-a17b-a454fe3ea6c4 service nova] Creating event network-vif-unplugged:d1cd745a-6478-4f59-ad2c-346b7fe41e9f for instance b6a3aec5-42e2-40ea-a383-0e2bf1a52771 on hv-cinder-maste Oct 24 08:59:40.290252 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-38bcded9-06a2-49eb-97a9-8f26d462e36f req-8a565662-34b9-4b5a-a17b-a454fe3ea6c4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092782 Oct 24 08:59:40.290887 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 510/1010] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:59:40.306620 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-a6294790-a8fc-4b94-89c2-25c7f0821663 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c4228e92254a65ada3a0a777812103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2806e58f714af7a7f739a59d3dece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:40.314541 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-a6294790-a8fc-4b94-89c2-25c7f0821663 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771" status: 200 len: 1573 microversion: 2.1 time: 0.165310 Oct 24 08:59:40.315172 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 501/1011] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:40 2022] GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771 => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 08:59:41.341711 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-9ab4dd33-352f-4262-b1f1-d7dcbb251df0 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:41.342579 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-9ab4dd33-352f-4262-b1f1-d7dcbb251df0 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:41.350680 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9ab4dd33-352f-4262-b1f1-d7dcbb251df0 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:41.351329 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9ab4dd33-352f-4262-b1f1-d7dcbb251df0 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:41.351875 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9ab4dd33-352f-4262-b1f1-d7dcbb251df0 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:41.352725 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9ab4dd33-352f-4262-b1f1-d7dcbb251df0 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:41.353295 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9ab4dd33-352f-4262-b1f1-d7dcbb251df0 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:41.353823 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9ab4dd33-352f-4262-b1f1-d7dcbb251df0 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:41.492225 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-9ab4dd33-352f-4262-b1f1-d7dcbb251df0 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c4228e92254a65ada3a0a777812103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2806e58f714af7a7f739a59d3dece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:41.500544 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-9ab4dd33-352f-4262-b1f1-d7dcbb251df0 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771" status: 200 len: 1573 microversion: 2.1 time: 0.165445 Oct 24 08:59:41.501110 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 511/1012] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:41 2022] GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771 => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:42.523303 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-fbbbc00a-e573-4ecd-aa1e-88b21cbcac2a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:42.523915 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-fbbbc00a-e573-4ecd-aa1e-88b21cbcac2a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:42.531202 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-fbbbc00a-e573-4ecd-aa1e-88b21cbcac2a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:42.531687 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-fbbbc00a-e573-4ecd-aa1e-88b21cbcac2a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:42.532120 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-fbbbc00a-e573-4ecd-aa1e-88b21cbcac2a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:42.532810 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-fbbbc00a-e573-4ecd-aa1e-88b21cbcac2a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:42.533266 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-fbbbc00a-e573-4ecd-aa1e-88b21cbcac2a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:42.533687 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-fbbbc00a-e573-4ecd-aa1e-88b21cbcac2a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:42.670047 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-fbbbc00a-e573-4ecd-aa1e-88b21cbcac2a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c4228e92254a65ada3a0a777812103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2806e58f714af7a7f739a59d3dece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:42.681421 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-fbbbc00a-e573-4ecd-aa1e-88b21cbcac2a tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771" status: 200 len: 1573 microversion: 2.1 time: 0.161785 Oct 24 08:59:42.681955 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 502/1013] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:42 2022] GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771 => generated 1573 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:43.712034 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-a2dbfedf-a37f-44ed-b5e8-42cb215494ad tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:43.712759 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-a2dbfedf-a37f-44ed-b5e8-42cb215494ad tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:43.721127 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a2dbfedf-a37f-44ed-b5e8-42cb215494ad tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:43.721731 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a2dbfedf-a37f-44ed-b5e8-42cb215494ad tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:43.722262 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a2dbfedf-a37f-44ed-b5e8-42cb215494ad tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:43.723164 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a2dbfedf-a37f-44ed-b5e8-42cb215494ad tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:43.723722 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a2dbfedf-a37f-44ed-b5e8-42cb215494ad tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:43.724249 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-a2dbfedf-a37f-44ed-b5e8-42cb215494ad tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:43.864386 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-a2dbfedf-a37f-44ed-b5e8-42cb215494ad tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c4228e92254a65ada3a0a777812103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2806e58f714af7a7f739a59d3dece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:43.872660 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-a2dbfedf-a37f-44ed-b5e8-42cb215494ad tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771" status: 200 len: 1573 microversion: 2.1 time: 0.166931 Oct 24 08:59:43.873229 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 512/1014] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:43 2022] GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771 => generated 1573 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 08:59:44.275466 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [req-944fe9fb-4f7a-4eb2-ada2-c78f902dbbb2 req-e67d4e63-e101-40c3-aa3a-2dcbfa4bee25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6a3aec5-42e2-40ea-a383-0e2bf1a52771", "name": "network-vif-plugged", "status": "completed", "tag": "d1cd745a-6478-4f59-ad2c-346b7fe41e9f"}]} {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 08:59:44.286036 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-944fe9fb-4f7a-4eb2-ada2-c78f902dbbb2 req-e67d4e63-e101-40c3-aa3a-2dcbfa4bee25 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:44.286517 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-944fe9fb-4f7a-4eb2-ada2-c78f902dbbb2 req-e67d4e63-e101-40c3-aa3a-2dcbfa4bee25 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:44.286973 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [req-944fe9fb-4f7a-4eb2-ada2-c78f902dbbb2 req-e67d4e63-e101-40c3-aa3a-2dcbfa4bee25 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:44.299173 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.compute.server_external_events [req-944fe9fb-4f7a-4eb2-ada2-c78f902dbbb2 req-e67d4e63-e101-40c3-aa3a-2dcbfa4bee25 service nova] Creating event network-vif-plugged:d1cd745a-6478-4f59-ad2c-346b7fe41e9f for instance b6a3aec5-42e2-40ea-a383-0e2bf1a52771 on hv-cinder-maste Oct 24 08:59:44.304547 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [req-944fe9fb-4f7a-4eb2-ada2-c78f902dbbb2 req-e67d4e63-e101-40c3-aa3a-2dcbfa4bee25 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032834 Oct 24 08:59:44.305404 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 503/1015] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 08:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 08:59:44.896181 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-9ce996c1-f573-4be7-8d8f-2d2c94b9facd tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 08:59:44.896791 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-9ce996c1-f573-4be7-8d8f-2d2c94b9facd tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 08:59:44.903789 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9ce996c1-f573-4be7-8d8f-2d2c94b9facd tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:44.904278 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9ce996c1-f573-4be7-8d8f-2d2c94b9facd tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:44.904710 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9ce996c1-f573-4be7-8d8f-2d2c94b9facd tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:44.905406 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9ce996c1-f573-4be7-8d8f-2d2c94b9facd tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 08:59:44.905859 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9ce996c1-f573-4be7-8d8f-2d2c94b9facd tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 08:59:44.906283 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-9ce996c1-f573-4be7-8d8f-2d2c94b9facd tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 08:59:45.049756 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-9ce996c1-f573-4be7-8d8f-2d2c94b9facd tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c4228e92254a65ada3a0a777812103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2806e58f714af7a7f739a59d3dece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 08:59:45.061675 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-9ce996c1-f573-4be7-8d8f-2d2c94b9facd tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771" status: 200 len: 1560 microversion: 2.1 time: 0.169150 Oct 24 08:59:45.062435 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 513/1016] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 08:59:44 2022] GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:20.979563 dv-cinder-master-3-smb devstack@n-api.service[125165]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4b294517-127d-4a95-85e6-bb808991cdd0] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 24 09:01:20.980534 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 09:01:20.980669 dv-cinder-master-3-smb devstack@n-api.service[125165]: Mon Oct 24 09:01:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771 (ip 10.222.0.26) !!! Oct 24 09:01:20.982631 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_api:SELECT=22 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:20.983392 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG dbcounter [-] [125165] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:20.984445 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-e6d3173a-88d3-4c05-b8f0-5c4c321e3e74 req-d1d4859b-9461-4c60-9d52-c1b4ba1980f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6a3aec5-42e2-40ea-a383-0e2bf1a52771", "tag": "d1cd745a-6478-4f59-ad2c-346b7fe41e9f"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:20.990346 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:20.991556 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG dbcounter [-] [125164] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:20.996303 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-3f1e5af8-7551-42aa-8976-e7a6420f221f tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:20.996918 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-3f1e5af8-7551-42aa-8976-e7a6420f221f tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:20.998822 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-e6d3173a-88d3-4c05-b8f0-5c4c321e3e74 req-d1d4859b-9461-4c60-9d52-c1b4ba1980f0 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:20.999365 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-e6d3173a-88d3-4c05-b8f0-5c4c321e3e74 req-d1d4859b-9461-4c60-9d52-c1b4ba1980f0 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:20.999865 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-e6d3173a-88d3-4c05-b8f0-5c4c321e3e74 req-d1d4859b-9461-4c60-9d52-c1b4ba1980f0 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:21.004464 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3f1e5af8-7551-42aa-8976-e7a6420f221f tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:21.004934 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3f1e5af8-7551-42aa-8976-e7a6420f221f tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:21.005593 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3f1e5af8-7551-42aa-8976-e7a6420f221f tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:21.006711 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3f1e5af8-7551-42aa-8976-e7a6420f221f tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:21.007302 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3f1e5af8-7551-42aa-8976-e7a6420f221f tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:21.008155 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-3f1e5af8-7551-42aa-8976-e7a6420f221f tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:21.016921 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-e6d3173a-88d3-4c05-b8f0-5c4c321e3e74 req-d1d4859b-9461-4c60-9d52-c1b4ba1980f0 service nova] Creating event network-changed:d1cd745a-6478-4f59-ad2c-346b7fe41e9f for instance b6a3aec5-42e2-40ea-a383-0e2bf1a52771 on hv-cinder-maste Oct 24 09:01:21.022616 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-e6d3173a-88d3-4c05-b8f0-5c4c321e3e74 req-d1d4859b-9461-4c60-9d52-c1b4ba1980f0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043293 Oct 24 09:01:21.023685 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 514/1017] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 09:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:01:21.037784 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-3f1e5af8-7551-42aa-8976-e7a6420f221f tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Going to try to terminate instance {{(pid=125165) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 09:01:21.122138 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-3f1e5af8-7551-42aa-8976-e7a6420f221f tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771" status: 204 len: 0 microversion: 2.1 time: 0.144765 Oct 24 09:01:21.122967 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 504/1018] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Oct 24 09:01:20 2022] DELETE /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 09:01:21.132524 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-559f9ae0-00bd-421c-8ec0-387be6acaea7 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:21.133262 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-559f9ae0-00bd-421c-8ec0-387be6acaea7 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:21.140894 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-559f9ae0-00bd-421c-8ec0-387be6acaea7 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:21.141408 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-559f9ae0-00bd-421c-8ec0-387be6acaea7 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:21.141855 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-559f9ae0-00bd-421c-8ec0-387be6acaea7 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:21.142595 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-559f9ae0-00bd-421c-8ec0-387be6acaea7 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:21.143077 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-559f9ae0-00bd-421c-8ec0-387be6acaea7 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:21.143538 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-559f9ae0-00bd-421c-8ec0-387be6acaea7 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:21.313070 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.policy [None req-559f9ae0-00bd-421c-8ec0-387be6acaea7 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c4228e92254a65ada3a0a777812103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2806e58f714af7a7f739a59d3dece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125164) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:21.320869 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-559f9ae0-00bd-421c-8ec0-387be6acaea7 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771" status: 200 len: 1566 microversion: 2.1 time: 0.192738 Oct 24 09:01:21.321633 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 515/1019] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:21 2022] GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771 => generated 1566 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:22.344601 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-d2a0ecd6-115b-4a78-8312-e38dd539c7ba tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:22.346042 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-d2a0ecd6-115b-4a78-8312-e38dd539c7ba tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:22.353754 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d2a0ecd6-115b-4a78-8312-e38dd539c7ba tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:22.354264 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d2a0ecd6-115b-4a78-8312-e38dd539c7ba tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:22.354699 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d2a0ecd6-115b-4a78-8312-e38dd539c7ba tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:22.355420 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d2a0ecd6-115b-4a78-8312-e38dd539c7ba tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:22.355866 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d2a0ecd6-115b-4a78-8312-e38dd539c7ba tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:22.356288 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-d2a0ecd6-115b-4a78-8312-e38dd539c7ba tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:22.362470 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO oslo.messaging._drivers.impl_rabbit [-] [4b294517-127d-4a95-85e6-bb808991cdd0] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 57754. Oct 24 09:01:22.536898 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-d2a0ecd6-115b-4a78-8312-e38dd539c7ba tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c4228e92254a65ada3a0a777812103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2806e58f714af7a7f739a59d3dece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:22.545141 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-d2a0ecd6-115b-4a78-8312-e38dd539c7ba tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771" status: 200 len: 1566 microversion: 2.1 time: 0.204891 Oct 24 09:01:22.545698 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 505/1020] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:22 2022] GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771 => generated 1566 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:23.383020 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [req-2e87bd55-6c0b-41e1-a10d-d63e63f22630 req-16301eec-a56c-47fb-8fd5-a53012c36dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6a3aec5-42e2-40ea-a383-0e2bf1a52771", "name": "network-vif-deleted", "tag": "d1cd745a-6478-4f59-ad2c-346b7fe41e9f"}]} {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 09:01:23.395218 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-2e87bd55-6c0b-41e1-a10d-d63e63f22630 req-16301eec-a56c-47fb-8fd5-a53012c36dd4 service nova] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:23.395689 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-2e87bd55-6c0b-41e1-a10d-d63e63f22630 req-16301eec-a56c-47fb-8fd5-a53012c36dd4 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:23.396110 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [req-2e87bd55-6c0b-41e1-a10d-d63e63f22630 req-16301eec-a56c-47fb-8fd5-a53012c36dd4 service nova] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:23.408079 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.compute.server_external_events [req-2e87bd55-6c0b-41e1-a10d-d63e63f22630 req-16301eec-a56c-47fb-8fd5-a53012c36dd4 service nova] Creating event network-vif-deleted:d1cd745a-6478-4f59-ad2c-346b7fe41e9f for instance b6a3aec5-42e2-40ea-a383-0e2bf1a52771 on hv-cinder-maste Oct 24 09:01:23.414337 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [req-2e87bd55-6c0b-41e1-a10d-d63e63f22630 req-16301eec-a56c-47fb-8fd5-a53012c36dd4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034565 Oct 24 09:01:23.415251 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 516/1021] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Oct 24 09:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 09:01:23.569886 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-1e1ff2d7-618a-40a2-bb67-2c6ececeb5a2 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Calling method '>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:23.570531 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.compute.api [None req-1e1ff2d7-618a-40a2-bb67-2c6ececeb5a2 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Fetching instance by UUID {{(pid=125165) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:23.577098 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1e1ff2d7-618a-40a2-bb67-2c6ececeb5a2 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:23.577604 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1e1ff2d7-618a-40a2-bb67-2c6ececeb5a2 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:23.578037 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1e1ff2d7-618a-40a2-bb67-2c6ececeb5a2 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:23.578731 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1e1ff2d7-618a-40a2-bb67-2c6ececeb5a2 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:23.579180 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1e1ff2d7-618a-40a2-bb67-2c6ececeb5a2 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:23.579609 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG oslo_concurrency.lockutils [None req-1e1ff2d7-618a-40a2-bb67-2c6ececeb5a2 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:23.644023 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.policy [None req-1e1ff2d7-618a-40a2-bb67-2c6ececeb5a2 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c4228e92254a65ada3a0a777812103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d2806e58f714af7a7f739a59d3dece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125165) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 09:01:23.654155 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-1e1ff2d7-618a-40a2-bb67-2c6ececeb5a2 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771" status: 200 len: 1218 microversion: 2.1 time: 0.088180 Oct 24 09:01:23.654739 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 506/1022] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:23 2022] GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 09:01:24.794039 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-34bbe507-f2aa-4354-bff9-c965cb41712d tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Calling method '>' {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:24.794746 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.compute.api [None req-34bbe507-f2aa-4354-bff9-c965cb41712d tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] [instance: b6a3aec5-42e2-40ea-a383-0e2bf1a52771] Fetching instance by UUID {{(pid=125164) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 09:01:24.801681 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-34bbe507-f2aa-4354-bff9-c965cb41712d tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:24.802180 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-34bbe507-f2aa-4354-bff9-c965cb41712d tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:24.802649 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-34bbe507-f2aa-4354-bff9-c965cb41712d tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:24.803374 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-34bbe507-f2aa-4354-bff9-c965cb41712d tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Acquiring lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 09:01:24.803836 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-34bbe507-f2aa-4354-bff9-c965cb41712d tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 09:01:24.804261 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG oslo_concurrency.lockutils [None req-34bbe507-f2aa-4354-bff9-c965cb41712d tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Lock "dfb1c4c1-9694-4501-9182-d459e78ba11f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 09:01:24.817723 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.wsgi [None req-34bbe507-f2aa-4354-bff9-c965cb41712d tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] HTTP exception thrown: Instance b6a3aec5-42e2-40ea-a383-0e2bf1a52771 could not be found. Oct 24 09:01:24.819369 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-34bbe507-f2aa-4354-bff9-c965cb41712d tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Request method failure captured: Oct 24 09:01:24.819369 dv-cinder-master-3-smb devstack@n-api.service[125164]: request: GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771 HTTP/1.1 Oct 24 09:01:24.819369 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept: application/json Oct 24 09:01:24.819369 dv-cinder-master-3-smb devstack@n-api.service[125164]: Accept-Encoding: identity Oct 24 09:01:24.819369 dv-cinder-master-3-smb devstack@n-api.service[125164]: Connection: close Oct 24 09:01:24.819369 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Length: 0 Oct 24 09:01:24.819369 dv-cinder-master-3-smb devstack@n-api.service[125164]: Content-Type: application/json Oct 24 09:01:24.819369 dv-cinder-master-3-smb devstack@n-api.service[125164]: Host: 10.222.0.26 Oct 24 09:01:24.819369 dv-cinder-master-3-smb devstack@n-api.service[125164]: Openstack-System-Scope: None Oct 24 09:01:24.819369 dv-cinder-master-3-smb devstack@n-api.service[125164]: User-Agent: python-urllib3/1.26.12 Oct 24 09:01:24.819369 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Auth-Token: gAAAAABjVlMxAK6xQYescf4rr4_MVillTsU1lUfxyFAO_AphY-fpsFKu39ca0lWbnt78WP1o45emgVdkINLtA_V-aIAkKsGGI2zrWIAGpgaexqIVKQeJF7mX_muoi4OubRCsf93rWfPnwxy8fOrjMVVunUVjJG5csLLMvO__YlVz9nEyZ9INn9k Oct 24 09:01:24.819369 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Id: None Oct 24 09:01:24.819369 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Domain-Name: None Oct 24 09:01:24.819369 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Identity-Status: Confirmed Oct 24 09:01:24.819369 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Is-Admin-Project: True Oct 24 09:01:24.819369 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Id: default Oct 24 09:01:24.819369 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Domain-Name: Default Oct 24 09:01:24.819369 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Id: 6d2806e58f714af7a7f739a59d3dece1 Oct 24 09:01:24.819369 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Project-Name: tempest-TestShelveInstance-1741658869 Oct 24 09:01:24.819369 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Role: reader,member Oct 24 09:01:24.819369 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Roles: reader,member Oct 24 09:01:24.821086 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6d2806e58f714af7a7f739a59d3dece1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6d2806e58f714af7a7f739a59d3dece1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d2806e58f714af7a7f739a59d3dece1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d2806e58f714af7a7f739a59d3dece1"}]}] Oct 24 09:01:24.821086 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant: tempest-TestShelveInstance-1741658869 Oct 24 09:01:24.821086 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Id: 6d2806e58f714af7a7f739a59d3dece1 Oct 24 09:01:24.821086 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-Tenant-Name: tempest-TestShelveInstance-1741658869 Oct 24 09:01:24.821086 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User: tempest-TestShelveInstance-1741658869-project Oct 24 09:01:24.821086 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Id: default Oct 24 09:01:24.821086 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Domain-Name: Default Oct 24 09:01:24.821086 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Id: a7c4228e92254a65ada3a0a777812103 Oct 24 09:01:24.821086 dv-cinder-master-3-smb devstack@n-api.service[125164]: X-User-Name: tempest-TestShelveInstance-1741658869-project Oct 24 09:01:24.821086 dv-cinder-master-3-smb devstack@n-api.service[125164]: method: > Oct 24 09:01:24.821086 dv-cinder-master-3-smb devstack@n-api.service[125164]: exception: Instance b6a3aec5-42e2-40ea-a383-0e2bf1a52771 could not be found. Oct 24 09:01:24.821086 dv-cinder-master-3-smb devstack@n-api.service[125164]: action_args: {'id': 'b6a3aec5-42e2-40ea-a383-0e2bf1a52771'} Oct 24 09:01:24.822085 dv-cinder-master-3-smb devstack@n-api.service[125164]: {{(pid=125164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 09:01:24.822085 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:24.822085 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 09:01:24.822085 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 09:01:24.822085 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 09:01:24.822085 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 09:01:24.822085 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 09:01:24.822085 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 09:01:24.822085 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 09:01:24.822085 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 09:01:24.822085 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6a3aec5-42e2-40ea-a383-0e2bf1a52771 could not be found. Oct 24 09:01:24.822085 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 09:01:24.822085 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:24.822085 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 09:01:24.822085 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:24.822085 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:24.822085 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:24.822085 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 09:01:24.822085 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 09:01:24.822085 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 09:01:24.823657 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 09:01:24.823657 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 09:01:24.823657 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 09:01:24.823657 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 09:01:24.823657 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 09:01:24.823657 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 09:01:24.823657 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 09:01:24.823657 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6a3aec5-42e2-40ea-a383-0e2bf1a52771 could not be found. Oct 24 09:01:24.823657 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 09:01:24.823657 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 09:01:24.823657 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 09:01:24.823657 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 09:01:24.823657 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 09:01:24.823657 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 09:01:24.823657 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 09:01:24.823657 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 09:01:24.823657 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6a3aec5-42e2-40ea-a383-0e2bf1a52771 could not be found. Oct 24 09:01:24.823657 dv-cinder-master-3-smb devstack@n-api.service[125164]: ERROR nova.api.openstack.wsgi Oct 24 09:01:24.825177 dv-cinder-master-3-smb devstack@n-api.service[125164]: DEBUG nova.api.openstack.wsgi [None req-34bbe507-f2aa-4354-bff9-c965cb41712d tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Returning 404 to user: Instance b6a3aec5-42e2-40ea-a383-0e2bf1a52771 could not be found. {{(pid=125164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 09:01:24.825177 dv-cinder-master-3-smb devstack@n-api.service[125164]: INFO nova.api.openstack.requestlog [None req-34bbe507-f2aa-4354-bff9-c965cb41712d tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771" status: 404 len: 111 microversion: 2.1 time: 0.145222 Oct 24 09:01:24.825177 dv-cinder-master-3-smb devstack@n-api.service[125164]: [pid: 125164|app: 0|req: 517/1023] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Oct 24 09:01:24 2022] GET /compute/v2.1/servers/b6a3aec5-42e2-40ea-a383-0e2bf1a52771 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 09:01:24.992533 dv-cinder-master-3-smb devstack@n-api.service[125165]: DEBUG nova.api.openstack.wsgi [None req-5586aadd-82e8-44f5-9b3c-2e7ff692dc66 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] Calling method '.version_select at 0x7f7ef150d3a0>' {{(pid=125165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 09:01:25.017306 dv-cinder-master-3-smb devstack@n-api.service[125165]: INFO nova.api.openstack.requestlog [None req-5586aadd-82e8-44f5-9b3c-2e7ff692dc66 tempest-TestShelveInstance-1741658869 tempest-TestShelveInstance-1741658869-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-805533992" status: 202 len: 0 microversion: 2.1 time: 0.028616 Oct 24 09:01:25.018085 dv-cinder-master-3-smb devstack@n-api.service[125165]: [pid: 125165|app: 0|req: 507/1024] 10.222.0.26 () {58 vars in 1251 bytes} [Mon Oct 24 09:01:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-805533992 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)